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ABSTRACT , - 

This report describes a study of 23 community-based 
child, advocacy projects, located in 1U states and 2C cities, and 
outlines a strategy for evaluating such projects. Data on each 
project's history, develoment, and current activities were obtained. 
Data were analyzed to (1) letermine how such projects are started- and 
become operational, (2) identify stages in project development, and 
(3) establish a strategy for evaluating eich identified stage of 
develppment. From the analyses, an evaluatio|i instrument for 
cojimunity-|)as€d child*' advocacy project's was developed and piloted on 
six of the 23 projects studied. Semi-structured interviews were 
conducted with staff at these ^ix prdjects to determine the relative 
i^access of each child-advocacy project in terms of its planning and 
implementation. Variables such as funding agency, leadership, program 
structure, and ^dvocacy objectives, processes, and targets were found 
to be important in program effectiveness. A review of evaluation 
researchv isTrCcluded. (BRT) 
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In recent years. Increasing emphasis has been placed 
on gauging the effectiveness of publ>rc and*^ volxintary social 
welfare programs.- The major social ^ction programs of ^ the 
last decade, as represented by CommunitjT Action Programs, 
Heads tart. Model Cities, Neighborhood Service Centers, have 
'been subjected to a variety of evaluations, in an effort at 
delineating their usefulness and results. The current Admihis- 
tjration has taken a strongly critical position towards all 
social progreuAs, suggesting that many have bein fovind ineffec- 
tive. At times, the pressure for ir^formation about effective- 
ness has led to efforts at evaluation prior to any precise 
*delineati?>n of the nature of , the program or determination 
of clear-cut norms regarding program impl emen ta A t o ws opera- 
tions or axrtivities. ' 

Within the last few years, another social action program 
has emerged, albeil; a modest one, and has been described as 
child advocacy". There is urgent need to assess the rela- 
tive merits of different child advocacy projects prior to any 
substantial investment^; thus, development of criteria for 

iThere is much confusion, in the literature and in the 
field regarding the use of the terms '^project" and "program". 
The clearest distinction is, made by Joseph Wholey in his 
study of federal evaluation policy. He defines a federal 
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evaluation and an over-all strJ^tegy of eval^uation arte 



esaentlal. 

This study represents a modest beginning at this" task. 
It is also hoped that through .the approach to evaluation 
developed here for child advocacy projects, some additional . 
perspective may be gained - seme lessons learned - regarding 
evaluation of social action programs general^^-'y . Bi;t before 
the method and rationale of thisi|^study are delineated, and 
the particular approach taken is Justified, it is necessary 
to explain something at>feut child advocacy itself - what it is, 
how it developed - and describe the initial study on which 
this one builds and jbhrough which thi§ researcher first be- 
came familiar with the phenomenon. 



* » 

program as "the provision of federal funds and administrative 
alrectlon to accomplish a prescribed set of objectives through 
the conduct of specified activities." A project is "the 
implementation levei^ of a program - the level where resources 
are used to produce an end project that directly contributes 
to the objectives of the program." Joseph. S. Wholey, et. al.. 
Federal Eva3,uatioh Policy ; Analyzing the Effects of Public 
Programs (Washington, D. C; Urban Institute ^ 1971) p. 24. 

Since many child advocacy projects describe them- 
selves albeit inappropriately as ''programs", it becomes dif- 
ficult to maintain this distitfctioj^ consistently. In addition, 
the term "program" is also used/ to describe the various 
activities of individual praj^ts (advocacy, information and 
referral, counseling) or the implementation of over-all policy 
and guideline.s when ^ project becomes operational. 

Although there may be some inadvertent inconsistency, 
effort will be made in this study to'use "project" when refer-' 
ring to an individual child advocacy organization or agency 
and "program" when referring to the cluster of activities pro- 
vided in and by the project^ - what the project does. However, 
'program'' may also be otherwise used when specifically em- 
ployed by others or when referring generally to such things 
as "social action programs" or "social welfare programs," as in 
the above. 

C 0 C^I 0 




Needless to say, aeither advocacy as a concept nor 
concern with the welfare of children generally, repx^Qsents 
a new phenomenon. ^Yet somehow the term "child advocacy" ^has 
the "ring" of something new and different. Increasingly, both 
the concept and the practice have been mentioned as possible 
solutions to a wide range of pro]t)lems concerning children. 
The concept has been used to highlight the inadequacy of our 
national commitment to children and the' enormity of the prob- 
lems faced by children in our society. Ac t ivities/7:alled 

♦ 

child advocacy have been suggested as a meanis for identifying 
and publicizing' the unmet needs of children^ providing alter- ^ 
native ways for meeting these needs and stimulating public 
and political support for implementing them. A National Cen- 
ter on Child Advocacy, established in the Office of Child 
Development in May, 1971^ was premised on the centrality of 
advocacy as an organizing principal for constructive action 
on behalf of children. In 1971-72, several federal agencies 
spent seven and one-half mtriidn dollars funding experiments, 
demonstrations and research under the general heading of 
"child advocacy". Still more projects .were funded subsequently, 
by both public and voluntary agencies, at various governmental 
and non-governmental levels; additional ones are plannera\/ 
State committees under a diversity of names have developed 
advocacy proposals and projects. 



In response to what appeared to be an emerging movemept, 

^) ■ 
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in 1971 the Office of Child Development decided to fund a one 
year research prr>;Ject at Columbia University School of Social 
Work, aimed at clarification of the concept and practice of 
child advocacy. The conclusions of this study are reported 
in the monograph. Child Advocacy , published in January, 1973.^ 
The study, included a review of ' the literature, interviews with 
key experts in the field, a broad-based mail survey of child 
advocacy projects and a sei^ies of case studies of selected , 
Projects in severil categories. One objective was to deter- 
mine whether or not the label "child advocacy" represented 
anything new and distinctive or was merely a new name for what 
had always gone on; a second, was to discover whether there 
was a cohesive theme underlying these diverse activities and 
whether it could be conceptualized. 

We began our study by trying to discover when the term 
"child advocacy" was first used, and why. What were its Im- 
mediate antecedents? Where did child advocacy stem from? 

Three events in recent years appear to have precipi- 
tated current developments and represent the first genetfral 
usage of the term: The establis^hment of the Office of fcmid 
Development -in 1969, with its previously mentioned sub-unJ 
the National Centei' on Child Advocacy; publication in 19( 



lAlfi^ed J. Kahn, Sheila B. Karaerman and Brenda G. McGowan, 
Child Advocacy : Report of a ' National Baseline Study (New York: • 
ooiumoia University- School 6f Social Work, 197 jfi Much of the 
material included in this introductory chapter- is derived from 
thlg report. 
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of the Report of the Joint Commission on the Mental Health' 
of Children; and the White House Conference on Children and 
Youth in 1970. These last two recommended the. establishment 
of an elaborate hierarchical child advocacy system with opera- 
'tional units at various governmental .levels ra?jgl*ng fyom iwigh- 
borhood to national. Apparently influenced by this, several 
of the proJects( funded, by the federal govemmerit represented' 
an effort at initfating such a formal 'structure, beginning at 
the neighborhood or community level. 

However, advocacy has a longer history.. The origins 
of child advocacy are traceable to the tradition of social re- 
form in this country : activities of the muclcrakers in the late ^ 
nineteenth century; the self-advocacy of .wortien suffragettes in 
the l&te. 19th anu early 20th cehturies;^ and the "child advocacy" 
of the first. White House Conference on Children in 1909/ re- 
sulting in the subsequent esl^ablishment of the Children's 
Bureau. i: 

In its current manifestation, child advocacy is' clear- 
ly influenced artd shaped by the developments of the 1960s. 
The civil rights movement led to increased concern with legal 
and extra-legal rights. The antirpoverty progl^ams - in 
paTticular,^ community action programs, neighborhood service 
centers, neighborhood legal .services ' - contributed substan- 
tially to the form and substance of many child advocacy projects 
\ 

ttjrough concern with such problems as delinquency, school 
reform, legal rights and entitlements, qualitative and quant i-' 
tative inadequacies in service delivery and citizen participa- 



tlbn, in addition to poverty. Although self-help groups 



of handicapped people or parents of handicapped^children • 
began to organize during the 1950s, such organisations were 
initiated' increasingly in the 1960s by ethnic and racial 
groups, or groups with shared problems (e.g., welfare rights). 

Writers and professionals frorn a variety of disci- 
plines emphasized the need for advocacy when working, for 
the poor and powerless. Social work, iif particular, bor- 
rowed thfe concept of client advocacy from the legal prp- 
fession and used it to describe such a partisan role.-'-' 
Others discussed the need'to support, othe rights of chii^dren 



ISocial workers wrote about the concept^iiwiS'^ractice ^ 
of "advocacy" as being the support of the rights of the 
disadvantaged generally. See% -for example, George A. Brager, 
"Advocacy and Political Beh^ixio/," Social Work , XIII^ 2 . 
(Aprils 1968) 5-15; "Institutional Change : Perline te rs of the 
Possible," Social Work , XII, 1 ^(January 1967) 59-69; Brager 
and Francis P. Purcell (eds.). Community Action Against 
Poverty , (New Haven, Conn.: College §Lnd University Press, I967). 
Charles Grosser, -^^Cornmunity Development Programs Serving the 
Urban Poor," Social Work; X, 3 (July I965) 15-21; Grosser and , 
Edward V. Sparer, "Social Welfare and Social Justice," in 
Brager and Purcell, op.^cit. , 29?-301. Scott Briar, "The 
Current Crisis in Social^JJasework. " Social Work t^ractice. 
Selected papers from the, 94th annual forum of the National- 
Conference on Social Welfare (New York: Columbia University 
Press, 1967) 19-33; "The Social Wbrker's Responsibility For 
The Civil Rights of Clients," New Perspectives ; The Berkeley 
Journal of Social Welfare, 1 (Spring 1967) 89-921 1 

\Lawyers erapnaslzed- the need for employing the advocacy 
role when "Working for the. poor to help them realize legitimate 
rights in their relationships with lar^e public institutions. 
See Edgar A. and Jean Camper Calm^* "War on Poverty: A Civilian 
Perspective." Yale Law Journal , ■LXXIII, 8 (July 1964) 13l6-134l; 
Grosiier and Sparer, op. clt l 
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specifically. Underlying the development of this advocacy 
rol^ was the premise that the failure to receive needed ser- 
vice resulted from inadequacies in the service system, not 

in the client; th\is, intervention and change were needed in 

/ 

those ihstitutions serving the client, where previously there 
had been preoccupation with helping the client %o adapt to 
^he existing situation. 

TJhroughout all of the above, as well "as related devel-| 
opments in advocacy planning, consiuner advocacy and public 
interest law, "J^here i? a dual thrust: 1) an effort at achiev- 
inr a greater measure of social Justice for all; and 2) an 
attempt at ensuring^ some degree of accountability by public 
and voluntary institutions to those being serviced and/or 
the public a^ large. These themes .underlie current develop- 
ments in chil^ advocacy also. 

The 1972 study surveyed II6 child advocacy projects, 

75 of which were visited for periods ranging from one-half 

2 

day to two weeks. By no means should theae be construed as 
representing a complete picture of child advocacy projects, 
since more and more were identifj.ed in the course of the study. 
Furthermore, some of those labeled, when, visited, showed little 



■""Bernard J. Coughlin, *'The Rights of Children/' Ctiild 
Welfare , XLVII, 3 (I4arch I908) 133-142; Rebecca Smith, "For 
Every Child. . .A Commentary on Developments in Child Welfare 
I962-I967V' Child Welfare , XLVII, 3 (March 196B) pp* 125-132; 
thePr^idents Task FcJrce on Early Child* Development, J. McV. 
Hunt, Chairman, "A Bill of Rights for Children.*' Washington, 
-D. C. Office of the Secretary, Department of Health, Education 
and Welfare, I967. 

» 

^Kahn, Kamerman, McGowan, 0£. clt > , p. 36. 
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semblance of an advocacy fiinctlon. This confusion and 
ambiguity we P||\ Inevitable, since we were exploring an un- 
knownr^domain^^Yet, even^considering these incorjsistencies, 
some patterns emerged, and these are identified and sum- 
marized below. „ ' ^ I 

Poc the .mos€ part, projec^ts are concerned with the 
needs of' children and their families rather than children 
alone. A few, especially those with^a ybuth focus, distin- 
guish 'between the interests of children and their parents and 
may even note a conflict of interests. In general, projects 
are about equally divided between those which focus on the 
needs of a special group of children, and- those which focus 
on the needs of all 'children. With regard to. the latter 
group, most address the needs of poor and/or minority child- 
ren, although some are concerned with special categories, 
such as delinquent or handicapped. A "universal'* approach, 
with emphasis on children and families in greatest need, 
appropriately characterizes these projects. 

Projects are urban, small scale and nationally dis- 
trlbuted. They tend to cluster at either the state level, 
with state funding or at the community level with federal 
funding. Although tax-exempt foundations, voluntary agencies 
and self-help group* are actively involved in the organization 
of child advocacy projects, most of those identified are 
supported by public funds (federal, state, county) or at 
least by a combination of public and private financing. 

.. ■ ' . . OCCIG 



In general, the advocacy activities or these projects 
can be classified as employing one of two distinct approaches 
which sometimes OA^rlap: 1) case advocacy - changing, im- 
proving or assuring needed help for or service to individuals 
or fami3tes> ; 2) class advocacy - changing, improving or assur- 
ing needed help fo^ or service to classe's or groups of people . 
Child advocacy ranges, th^erefore, from direct services to so- 
cial action. Althougly most projects stress one or the ot^ier 
of these approaches, some include both. 

Although' the study did not develop any formal typology 
of child advocacy projects, it did delineate c^p^in varia- 
bles, which, with further research, might provide the basis 
for such a classification scheme. For example, projects can 
be classified according to base of operaticyis (federal, re- 
gional, s^ate, county, city, neighborhood auspice (public, 
voluntary or mixed); type of advocacy employed (case, 'class 
or both; lay, legal, or a combination); staff (proftBsional, 
paraprofessional or volunteer; single or multi-discipline); 
role (specialized or general); leadership ; entry point for 

Q 

advocacy intervention (case, survey, probllem study, moni- 
toring or regvdatory service, self-help); target for change 
(the case, local service system, administrative agency, legis- 
lative body, court system); number of targets addressed (singl 
or multiple) . 

Our initial explorations led us to conclude that the 
term often was a "gimmick", used merely to. obtain funding and 

00017 
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clearly not representing anything new or different." Cer- 
tainly, the label wa^s being used in a variety of ways to 
describe disparate and sometimes conflicting functions ii Yet, - 
gradually, as the study progressed - and as more projects were 
visited and more practitioners interviewed - our perspective 

4 

changed. The final report, concluded that in spi,te of the 
gimmickry and confusion, the advocacy "movement^' does have a 
distinctive quality and does represent a new Approach to the 
needs of children. . - 

As one facet of the burgeoning movement in public in- ^ 
terest advocacy, child advocacy places particular emphasis on 
making child-serving agencies, institutions and systems more 
responsive to the rights and desires of their consumers. This 
approach distinguishes it from the more traditional child wel- 
fare programs, which at'lempt to enhance the development of 
children through intervention in the lives of children and/or 
their families. Within this context, child advocacy seems to 
represent a response to certain newly-identified societal 
needs of children and their families'. Currently, children are 
seen as developing within a much broader social environment 
than their immediate families, although the family unit con- 
tinues to represent the primary environment. Secondary in- 
stitutions and groups^ such as schools, child care facilities 
and institutions, are also seen as having substantial influence 
on children's lives and development. Thus, wheji problems 
arise, it may not be the child or his family whose behavior 
must fee modified; instead, these institutions may require in- 

£r|c - C0018 
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terv^ntion, change or regulation. Proponents of this 
approach would extend societal responsibility to Include 
concern for ensuring" .that Institutions are approprlate]jy 
responsive to children's needs; and child advocacy repre- 
sents one attempt at developing a device for facilitating 
thls^ ' . H 

Within this context, -we adopted the following defini- 
tion of child advocacy, later endorsed* also by the Office of ^ 
Child Development: " intervention on behalf of children in re^ 
I la.t;ton to those services and Instltutlona impinging on their 
lives 4 " Included in this definition were actArltles such as 
the following: developing needed services where none existed 
previously; persisting in services where others might not; 
assuring access to searvicea and entitlements; protecting new 
concepts of legal and extra-legal rights; mediating between 
ch^ildren or families and such institutions as schools, 
health facilities, and courts; facilitating self -organization 
of parents or adol^cents; changing policies, procedures, 
budgets, rules, laws. 

In addition to defining the concept and delineating- 
the parameters of 'child advocacy, the final report of the 
study Identified those factors which appeared critical in the 
development and implementation of child advc^cacy projects and 
provided guidelines for a classification scheme to describe 
existing projects. It concluded with some discussion of the 



^Kahn, Kamerman, McGowan^ op. cit . , Preface. 
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public policy implications of the child advocacy ''lAovement'' 
and possibilities for future project and progreim development. 

THE NEED FOR FURTHER STUDY AND EVALUATIpN 

Although important variables in the development of 
child advocacy projects were identified, knowledge about the 
relationships between and amorjig them remained imprecise and 
conclusions were at best tentative and preliminary. Most of 
the proJect^s studied were only recently established and thus 
provided limited data. Confusion about the concept, and prac- 
tice of child advocacy as well as the time limitations of the 
study precluded more definitive findings. For the most part, 
project goals appeared to be general and diffuse. Knowledge 
about the alternative ways of structuring agencies to carry 
out advocacy, and of the auspices under which they might oper- 
ate most effectively, was limited. Much conventional wis- 
dom about such matters could be wrong. Methods, techniques 
and strategies were understudied and underdeveloped and little 
was known about the interrelationship of goals, structure, 
and processes. In short, the initial monograph had not ex- 
hausted the research challenge. Furthermore, the recent his- 
tory of the phenomenon, the brief period of time most projjscts 
were in operation, the constraints and nature of the initial 
study, and the poor conceptualization of variables, did not 
permit any evaluative conclusions regarding efficacy of parti- 
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cular projects. Clearly, without greater specificity of 
.goals than was ach'teved inmost projects, no steuidards «of 
performance or precise measures of effectiveness could be 

a 

defined. 

Although funding sources do lay d^wn guidelines for 
projects and these may include a statement of goals,, such 

goals are usually broad; on occasion, the guidelines are con- 

,1' » ' 

flic ting and are subject to change. ^As mentioned earlier, in- 
dividual projects tend to be eqmlly diffuse about t^^ieir goals. 
Sinc^ funding sources may require evaluation from the very in- 
ception of the project., researchers are often compelled to 
study projects where no precise goals have been delineated, 
often before, they are even operational. Consequently. In 
an effort at clarifying objectives, evaluators often in- 
fluence the selection of goals and thus the nature of the 
project and the program in order to delineate something 
measurable. Althou^ some researchers view this as appro- 
priate, it does tend to alter the program, inhibit innova- 
tion, restrict feedback, and on occasion, to frustrate pro- 
Ject administrators. Pressure for premature evaluation has 
other unfortunate consequences, including the possibility of 
negating the worth of a project even before it is fully opera- 
tional, as well as distorting the nature of the program. Oc- 
casionally, projects are further confounded by multiple eval- 
uation studies: self-evaluation, the project's own plan for 
external evalxxation, the funding agency's plans for indepen- 
dent evaluation. 

9^. « 0 0 021 
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The rapid proliferation of child advocacy projects 
prior to any widespread clarification of the cohcept or 
practice has resulted in a hotable lack of consistency re- 
garding project development and program Implementation. Ex- 
periences on numerous site visits to child advocacy projects 
during the course of thf initial study revealed that neither 
administrators, boarcT members , service consumers nor outside 
reviewers have clear expectations regarding what projects 
should be doing after a specified period of time in operation. 
It is apparent that those responsible for funding, monitor- 
ing and evaluating projects, as well as those who would ini-p 
tiate them, do not as yet have access to systematic infor- 
mation about basic aspects of child advicacy projects. In- 
evitably, therefore, evaluation strategy is dl^fficult to 
develop. 

Finally, no completed evaluative studies of child 
advocacy were available at the time of the initial study and 
few creditable onesxwere^ in process. Of these, each was i'ocused 
only on one project or on like projects in a specific funding 
cluster.^ Trihs, even though a recent report by the Urban 
Institute, or>e of the leading independent research institutes 
in the coTontry, rectsnmended Jettisoning the single project 
ev^uation study in favor of miati-project evaluations, 

^Por example, the OCD-funded study of seven Parent- 
Child Center - Advocacy Projects, by the Center for Community 
Research; the Bureau of the Bducatiortally Handicapped - National 
Institute of Mental Health (BEH-NIMH) Jointly funded study of 
six community-based child advocacy projects by Exotech-Mark 
Battle. 

?r ' eOC22 
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among those evaluations of child advocacy underway, none was 
attenqpting a comparative evaluation study of different types 



of child advocacy projects.^ 



THE FOCUS. OF THIS STUDY 



This lack of basic Information and systematically ac- 
cumulated eiq)erience became the basis for the present study's 
point of departure: the need to seek out and identify what 
generally occurs in child advocacy projects after they have 
been funded as a basis for prograjn and evalxxation strategy. 
Constraints of budget, time and staff suggested the wisdom 
of limiting this focus further. The fact that community-based 
projects were the single largest operational unit - and were 
overwhelmingly predominant among those projects funded by the 
federal government - suggested concentration on this parti- 
cular group. 

.After a period of reflection on ^the first study, an 
initial review of the literature, and some analysis of local 
project experience generally, the following preliminary study 
questions were listed: 

1) How long does it take for projects to become operational? 

2) Are there any identifiable patterns by which community- 
based child advocacy projet^ts become operational? 



"Krholey, et. al.. Federal Evaluation Policy 
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3) Are there stages or phases within this process and 
if so, how may they be concept\ia]^ized? 

4) What can be expected of a project after specified 

periods of time? What types of evaluative iss^ies^ 

are relevant at given points? 
f 

, 5) What variables may account for differential devel- 
opment patterns eunong projects? 
In short, the first euid major focus of this atudy be- 
came the process by which community-based child advocacy 
projects become operational. Thus, the study is concerned, 
ultimately, with the timing and expectations appropriate to 
evaluation studies and reports and with the identification of 
guidelines' that would permit more systematic experimentation 
in child advocacy. Findings should assist future funders 
and project directors in planning, programming and project 
development. It was projected that CMice this information be- 
<:ame available, the second major focus of this .study could be 
an effort to evaluate these projects, concentrating on effects 
and effectiveness. According to our definition of child ad- 
Vvocacy, projects address the needs of children and attempt to 
cKange, affect, or influence sucli institutional systems as the 
school, health and mental health services, public welfare de- 
partments. Juvenile Justice systems. For the purpose of this 



■•"For discus&ion of "systematic experimentation" see Alice 
Rivlin, Systematic Thinking for Social Action (Washingt;on, D. C: 
The Brookings institution, l^TT) pp. tJb-119. 
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study, the "chans#" or intervention so identified 'may in- 
volve policies of other agencies, administrative procedures, 
staffing patterns, provision for monitoring of services 

« 

and/or activities, the content of legislation. Evidence of 
such change, appropriate for evaluation, may range fr9m ac- 
tion taken, services rendered and policies revised, to laws 
written and new programs initiated. 

Within this context, the preliminary plan for the second 
phase of the study assumed that evaluation efforts would deal 
with such things as: the types of institutions or service 
systems addressed by child advocacy projects and an indica- 
tion of which seemed most susceptible to change and why; the 
types of interventions employed, which are most effective and 

4 0 

Why;' the implied criteria for successful intervention or 
change; indices and measures of success; and, finally, which 
of "the various, child advocacy projects would appear to\be most 
effective for achieving change and why. Since none of the 
projects selected for study would be more than two and one- 
half years, old at the onset of the study, conclusions regard- 
ing their achievements woxild necessarily be viewed as pre- 
liminary and tentative. The research design could do no more 
than place many of the findings in this phase on the level of 
hypotheses for further study. In fact, as will be seen sub- 
sequently, many ojf these questions proved to be premature for 
any child advockcy undertaking that is less than two and one- 
half years old. V 

o 0C025 
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All of this will be better understood within the con- 
text of some reference to the relevant literature. The 
next chapter will address . this , before subsequent descrip- 
'tion of the sjtudy methodology. 



\ 
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CHAPTER II 



-XJHILD ADVOCACY. E VALUATION RESEARCH AND ORGANIZATiaNAL 
D E VELOPtteWT; A REVIEW OF THE JLITEMURE . 




Although cpnsldertCpB literature has developed around 
the subject of child advocacy, much of It is merely exhortation. 
Little substantive attention has been paid either to the process 
by which projects b^Ane ope rationale or to various types of 
projects that have developed. To date the literature has con- 
sisted largely of discussions of the value of child advocacy,^ . 
critiques of the concept, approach €uid implications , dis- ^ 
cus-sions of differential conceptualizations, ^ and proposals fpr 
specific program models.^ The substance of this literature has 
befen thoroughly reviewed in the earlier monograph5*and no 
further mention seems necessary here. 



^Mary Kohler, "The Rights of Children: An Unexplored 
Constituency," Social Policy I, 6 (March-April 1971) 36-44. 

2jerome Cohen, "Advocacy and the Children's Crisis," 
American Journal of Orthopsychiatry XLI, 5 (October 1971) 
b07-0b: Richard J. flould, "Children's Rights: More Liberal 
Games, Social Policy I, 7 , (Ju^y -August 1971) 5^-52. 

^David Cohen*^ "Politics and Research: Evaluation of 
Social Action Programs in Education," Carol H. Weisa, ed. 
Evaluatin g Action Programs (Boston: Allyn and Bacon, Inc. 

1972) iJp. 137-i6b; Jane Knitzer, "Advocacy and the Children's 
Crisis,^ American Journal of Orthopsychiatry , XLI, 5* (October 
1971) 799^BCF^^ ~ ' . ' f 

S/ilbert L. Lewis, "Child Advocacy and Ecological Planning," 
Mental Hygiene LIV, 4 (October 1970-) 475-83; Wolf Wolf senberger, 
"Toward Citizen Advocacy for the Handicapped," Lincoln, Nebraska, 
Nebraska Psychiatric Institute. University of Nebraska Medical 
Center. (Undated Mineographed) 

^Kahn, Kamerman, McGowan, op. cit . 

ERIC . . 00027 ^ 
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Other literatture that has particular relevance for this 

study, includes: 1) *the substantial literature on principles, 

methods and illustrations of evaluation research; 2) some 
' ' ' % 

literature related to organizational growth and development; 

3) a few studies of related social programs and policy issues; 

4) evaluation studies of child advocacy projects in process* 
It is "this literature that will be summarized and discussed 
In what follows* 

EVALUATION RESEARCH ' ' 



it Sta1 
)Clal Programs 



J e Current State of the Art and the Need for Evaluating j 
clal Programs 

Although important developments in evaluation research 



ocdurred during World War II and itnmediately thereafter, the 
field as we khow it today received its greatest impetus 
during the 1960s, as a r,esult of the proliferation of social 
action progrctais established as part of the anti-poverty war*"*" 
Just as the experiences of the ^ 1960s ^stimulated renewed 
concern' with poverty, political powerlessness, social Justice, 
individual rights, consumer and client accountability, 
similarly, the proliferation of large-scale, broad-aim social 
programming during that decade led to the need for evaluating 
its relative effectiveness for achieving desired social 
change* Evaluation research, long of secondary interest to 
professional researchers, received increasing attention in 



■'■Robert Morris, ed> , Encyclopedia of Social Work (New 
ational Association of Social Workers, 1971}, loth 

* 



York: • National 
Issue, II, pp. 1122-23. 
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those years as ^he federal government sharply expanded Its 
Investment In such studies Currently, the extent of the . 
federal government's commitm^ent to evaluatiorj research can 
be demonstrated by the number of such studies in process or 
completed wJIJln the last two years, and the dollar amount 
expended on them. For example, in fiscal M969 and 1970, 
OEO spent over $170 mi^-lion on six consultation, evaluation, 
techni^l assistance and support contracts. Between the 
time that OEO was established in 1966 and the beginning of 
1972, aboi2it.$600 million was committed to such contracts, 
Includfed among these w^e 44 evaluations of a single program, 
Headstart, 

One hundred and forty-six evaluations of HEW- funded 
poverty programs are either oonqpleted or in process,-' 
Curr^tly, according to a recent memorandun, the Department 
of Health, Education and Welfare is funding more than I30 
evaluation studies at $25^000 or more, for a total cost of 
at least $15 million; the Department of Justice has 100- 
such studies costing about $8 million; OEO, the Office of 



■'-For the history of evaluation research and its 
resurgence in the 60s, see fedward A, Suchman, Evaluative 
Research (New York: Russell Sage, 1967), Chapters \ and II; 
and Francis G, Garb, '"Evaluation Research:* An Overview," in'' 
Francis G, Caro, ed,. Readings in Evalxiation Research (New 
York: Russell Sage, V^JTf. 

^Establi^shlng Priorities Among Programs Aiding the 
Poor , Hearing Before the Committee on Finance, Unitea States 
Senate, Nihety-Second Congress, Second Session, February 15, 
1972, p. 38» 

3lbld >, pp, 186-201, 
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Education and the National Center for Health Services have 

respectively 25 studies for $2 million, 45 studies for $9 

^ 1 
million, and 300 studies for $21 million. Activities of 

private foxmdatlons such as Russell Sage reveal a similar 

pattern. According to Its 1970-71 Annual Report ^ beginning 

In 1969* the foundation developed a program for Improving 

the current state of evaluation research and Increasing 

Its utility for policy makers. The Report specifies that 

studies of social change, such as evaluations of social 

action programs, deserve primary research attention. It 

states, "one reason for- the Increasing attention on 

evaltxation Is that surprisingly little Is known about the 

actual conduct of most action programs and whether they 

have the Intended Impact, Moreover, competition Is ever 

increasing for resources, both human and material, and 

often there Is little basis for deciding Intelligently 

where to allocate these recourses* "3 

Current literature clearly reveals the need and 

Importance of evaluation studies of social action programs. 

The publication of three excellent readers on evaluation 

research within the past year attest to Increased Interest 

"""Arlene Amldon and Orvllle G. Brim, Jr. , Policy and 
Evaluation Research on Child Care Programs . Memoranaum 
prepared for the Advisory Committee on Child Deveopment, 
National Research Council, National Academy of Sciences, 
1972 (Mimeographed). 

2 

* Russell Sage Foundation Annual Report ^ 1970-71 
(New York: Russell Sage, 1971 p. 32. 

3lbld., p. 31. 
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and concern with such studies, and with the field generally.^ 
Essays In each stress the necessity and relevance of evalxiatloh 

research for social policy, but comment equally on the Inade- 

p 

quacles of available research. Similarly, the works of 
Suchman,3 Rivlln,^ Weiss, ^ Williams,^ Freeman and Sherwood''^ 
all emphasize the same theme, although their perspectives on 
the Interrelationship between policy and research may vary. 



Caro, Readings ; Weiss, Evaluating Action Programs; 
Peter H. Rossi ana waiter Williams, eas. bvaiuatlng Social 
Programs; Theory, Practice and Politics (New York: Seminar 
Press, 1972). The above include collections of articles 
on the theories, practice, politics and utilization of 
evaluation research as well as Illustrations of past and 
present work In the field. 

^See especially the Introductory essays In each volume. 

o 

-^Edward A. Suohman, "Action for What? A Critique^ of 
Evaluative Research", In Weiss, Evaluating Action Programs , 
pp. 52-84; Suchman, "Evaluating Educational Programs "7 In 
Caro, op. clt. , pp. 43-49; Suchman, Evaluative Research . 

4 ^ 
Rlvlln, op. clt. 

^Welss, Evaluating Action Programs ; Weiss, Evaluation 
Rese&rch (Englewood Cliffs, N.J.: Prentlce-Hall, 1972) . 

Walter Williams, Social Policy Research_and Analysis 
(New York: American Elsevier Publishing Co., 1971); Rossi and 
Williams, op. clt. 

7 

'Howard E. Freeman and Clarence C. Sherwood, Social 
Research yid SocIclL Policy (Englewood Cliffs, New Jersey: 
Prentice -Hall, Inc., 1970). 
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The relationship between social policy and social 
research is clearly recognized and has received growing 
emphasis. Professionals in both areas are working together 
more closely and both recognize the interrelationship between 
the two areas ^ although the problems of integrating the resxilts 
of research into policy analysis and decision making is 
obviously complicated by the political context in which such 
decisions are made. Some of the current difficulties regard- 
ing the state of evaluation research are as much related to 
the politics of research as to research methodology, and 
discussions of the problems in the utilization of research 
findings abound in the literature."*" 

Despite the substantial commitment of the federal govern- 
ment to evaluative research, the enormous n\imber of such studies 
recently completed or in process, the extensive discussions 
in the literature, and the consensus regarding its potential 
utility for influencing policy, the current state of the art 
is still largely inadequate and useful studies oP social action 
programs are rare. 

What Evaluation Reseajgch is and How it is Defined ^ 

Before proceeding with some discussion of the ob^ljkples 
surrounding evaluation research, some clarification of v»Mt is 



See Rossi. "Evaluating Educational Programs", in Caro. 
op. cit . ; Weiss, "The Politicalization of Evaluation Research , 
in Weiss, Evaluating Action Programs ; Williams, Social Policy 
Research and Analysis for a discussion of the distinct: ion 
. between policy analysis cund evaluation research; and Walter 

Williams and John W. Evaris, "The Politics of Evaluation: 
♦ The Case of Headstart", in Rossi and Williams, op. cit. , 
pt>» 249-26^; Freeman and Sherwood, Social Research and 
O Social Policy , (Englewood Cliffs, N.J.: Pi:*e'htl66-HA11, Inc., 
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meant by the term Is essential. Current definitions of 
evaluation tend to Involve a dual approach: the collection 
of Information regarding program outcomes (and goal achieve- 
ment) and Judgments regarding the value of the program (and 
Its goals). Suchman tends to stress the fact-finding aspect; 
however, even he Insists that evaluation begins with a value, 
either implicit or explicit. He defines evaluation as 

the determination (yhether based on opinions, 
records, subjective or objective data; of the 
results (whether desirable or undes Irable ; trart- 
sient or permanent; immediate or delayed) attained 
by some activity (whether a program, a part of a 
program, a drug or a therapy, an ongoing or one 
shot approach) designed to accomplish some valued 
goal or objective (whether ultimate, intermediate, 
or immediate, effort or performance, long or short 
range) 

In addition, he suggests five categories of criteria according 
to which the success or failure of a program may be evaluated.^ 
1) Effort (the quafitity and quality of activity that takes 
place); 2) Performance (the results of effort, based on a 
precise delineation of objectives); 3) Adequacy of Performance 
(the degree to whichi effective performance satisfies the 
total need for it); k) Efficiency^ (the degree to which the 
results are proportionate to the effort expended, e.g., costs); 
5) Process (how and why the program works and effects are 
achieved). 3 



■^Suchman, Evalqatlon Research , pp. 31-32, (emphasis * 
author ' s ) 

^Ibld ,. pp. 31-32, ^ , 

^Ibld , . pp, 6i-66, 

^ \ 0 0 0C3 
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Brooks also eiqphaslzea the informational componmt^ def ini|rig 

evaluation as 

1) determination of the extent to which a 
program achieved ^ts goals; 2^ determination 
of the z*elative importance of the program key 
variables in bringing about the insults observed 

3) determination of the role played by 
program variables^ as opposed to variables 
external to the program in bringing about the 
observed results . . . l 

Similarly, layman and Wright define evaluation as "fact-finding 

about the results of planned social action" while Oreenberg 

states that evaluation is "the procedure by which programs 

are studied to ascertain their effectiveness in the fulfull- 

ment of goals ."3 

Although aJimost all researchers would agree that the 

purpose o^ evaluation research is to provide information for 

decision-making programs, some place greater stress on this 

facet than others* Emphasizing the relationshi{i between 

research and policy, Weiss defines evaluation as "finding 

out how well action programs work* to discover information 

of importance to program practice and public policy* "^ 



^Michael P. Brooks, "The Community Action Program as a 
Setting for Applied Research," Caro, op^cit * , pi 57. 

^Herbert H. Hyman and Charles R. Wright. "Evaluating 
Social Action Programs," Caro,_o£^£lt. , p. 185* 

3b. G. Oreenberg,, "Evaluation of Social Programs," 
Caro, o£^£lt. , p. 155* 

^Carol H. Weiss, "Utilization of Evaluation: Toward 
Comparative Study, " Weiss, Evaluating Action PrngrAmg^ 
Pf '323* 
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Alkln defines It as 

^ . 

the process of ascertaining the decision areas 
of concern, selecting appropriate Information, 
collecting and analyzing Information In order to 
report summary data useful to decision makers In 
selecting among alternatives 

Freeman and Sherwood state that ^ 

evaluation provides the basis for the policy 
maker's decisions concerning the continuation, 
modification, expansion, or elimination of 
progradls directed towards the amelioration of 
social ills ,2 

This approach Involves two activities: assessing how well 
the program Is carried out and measuring its. Impact Both 
Rossi ajid Williams stress the complementarity of policy 
analysis and evaluation, pointing up their distlnctlvenesis 
and emphasizing that the effectiveness of a program is only 
one component of the ultimate Judgment regarding its worth. 
Although most of the aforementioned researchers focus 
on the controlled experiment as the ideal design for evaluation, 
Cain and Holllster eqxrnte i^alxiatlon with cost/benefit 
analysis while others distinguish the approaches. Related 
to the distinction between policy analysis and research, 
however. Is the distinction they make between a priori cost- 
benefit analysis (what Williams defines as policy analysis) 



^Marvin C. Alkln, "Evaluation Theory Development," In 
Weiss, Evaluating Action Programs , p. 107. 

^Freeman and Sherwood, op. clt .. p. 11. 

3 Ibid. , p. 12. 
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£i post analysis ^^what is generally defined as evaluation 

research. )■'■ ^ 

^The Judgmental atepect of evaluation resea^h receives 

particular emphasis by Scriven, who defines it as a method 

consisting of "the gathering and tomblxilng of performance 

data with a weighted set of goal scales." He insists that 

evaluation includes both the evaluation of goals as well as 

their achievement. Stake, too, states that evalxxation must 

be both descriptive and Judgmental, ^ while Perman emphasizes 

this even more strongly, stating that 

^ "The primary interest in evaluation is not to 
arrive at certain findings, as in pure science, 
but rather to make Judgements about the value 
of a technique, process or activity."^ 

The Judgemental aspect receives greatest enqphasis in 

Weiss and Rein's approach to evaluation which employs a 

qualitative rather than quantitative technique.^ Such a 

method facilitates explicit inclusion of values, an approach 

that these researchers believe is particularly appropriate • 

with regard to broad-aim programs. 



^Glen 0. Cain and Robinson G. Hollister, "The Methodology 
of Evaluating Social Action Programs," in Rossi and Williams, 
op.cit . > pp. 110-137* 

^Michael Scriven, "The Methodology of Evaluation," Weiss, 
fevaluatton Action Programs > p. 127. 

3Robert E. StaJce, "The Countenance of Educational , ' 

Evaluation," in Weiss, Evaluating Action Programs > p. 35'. 

^ouis A. Perman, "Some Perspectives on Evaluating Social 
Action Programs. The Annals of the American Acadeflqr >CCCLXXXV 
(September 1969)^ p.^ 153* 

^HQtj^j.^ S. Weiss and Martin Rein, "The Evaluation of 
Q Broad-Aim Programs: Difficulties in Eroerlmental Design and 
ERIC Alternative," In Weiss, Evaluating Action Programs j pp.236-249* 

^ 0 0.03 6 ' 
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Finally, Tripodi, Pellin and Epstein in their definition 
of evaluation, attempt to incorporate all three aspects; 
information gathering. Judgment and policy, According to 
them: 

Evaluation is the sy3tematic accumulation of 
facts for providing information about the achieve- 
ment of program requisTites ji.nd goals relative to 
effects, effectiveness and efficiency within any ^ 
i stage of program development. The facts of 

evaluation may be obtained through a variety of 
relatively systematic techniques, and they are 
incorporated into some designated system of values 
for making decisions about social programs. 

In summary, although there may be variations in emphasis, 

evaluation research is defined as systematic fact-finding in 

order to assess the effort, efficacy, adequacy, process and 

efficiency of a program or system of intervention in order 

to determine its work or social utility, either alone or 

compared with alternative approaches. It includes concern 

with input, outcome and impact. Along with values and 

political feasibility, it is an essential ingredient of soo^l 

polifjr, as well as being one way for Judging the effectiveness 

of such policy. Ideally, it is an integral part of the 

planning process, both following program implementation as 

well as providing the basis for further planning, policy change 

and progrcun refinement,-^ 



-""Tony Tripodi, Phillip Pell;in and Irwin Epstein, Social 
Program Evaluation: Guidelines for Healthy Education and Welfare 
Administrators (Itasca, 111,: F, E, Peacock Publishers, 1971), 

^Ibid, , p, 12 

3Aifred J, Kahn, Theory and Practice of Social Planning 
(New York: Russell Sage, 1969)', PP* 323-373i stresses this 
approach to evaluation, n ^ 
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The Method of Choice; The Controlled Experiment; the Problema 
In Implementing This Design 

Moat researchers^ in particular, Cain and Holllster, 
Freeman and Sherwood, Greenberg, Rlvlln, Rossi and Williams, 
and Suchman would designate the controlled experiment, pre- 
ferably classical Fisherian experiments (or at least quasi- 
experiments with Impure control groups) as the method of 
choice for evaluation research,^ 

Rivlin, in her discussion of the need for evaluating 
the effectiveness of social programs, enqphasizes the need for 
"systematic social experimentation" rather than what she would 

term the "random innovation" pattern by which child advocacy 

2 

programs have developed. 

Regardless of their preference for rigorous design, 
without exception, all concur on thejproblems of implementing 
such studies. As is true in many p^^er areas of endeavor, the 
theory meets obstacles when applied to real life situations .3 ^ 

^In addition to the ^previously listed references,* see 
Rossi, "Testing For Success and Failure in Social Action," in 
. Rossi, Eyaluatihg Social Programs . pp. 46-47 for his list of 
five distinct levels in the nierarchy of evaluation research 
design, V 

^Rivlin, op^clt ,. Cain and Hbllister refer to this as 
Intentional exoerimentation, " They also discuss "serial' 
experimentation ' - attempts at implementing alternative concepts 
simultaneously to learn not only that a particular concept failed 
but why it failed. See Cain and Holllster, op, clt ,> pp, 132-35, 

3 

-'For a description of some of the obstacles to enqploylng 
e^qperlmental designs in social action programs see Weiss, 
Evaluating Action Pmprumfl . pp. 7-11, 329-330; Amldon and Brim, 
op, cit ,; Russell ^age> op, clt , ; Rossi and Williams, op. clt, > 
pp, lb-23j Weiss and Rein, In Weiss, op, clt ,; Peter Harris and 
Martin Reln^ Dilemmas of Social Reform; Poverty and Community 
Action in the United States (New York; Atherton Press, 1967) 
Y:T^^^ ^napT;er viii, "fiesearcn, provides a general critique of research 
£1^^^^ efforts in the anti-poverty p^grams, 0 Q Q g 



31 



ERIC 



First, all agree that the principal obstacle is that 
goals of social, action programs are generally broad, difflise, 
and multiple rather than specific, clear and limited. As. Cain 
and Hollister state, the need to specify objectives is a 
principal tenet of evaluation research, but agreement in 
principle has not facilitated its implementation. Rossi 
indicates that those programs designed to effect institutional 
change have ^tjjfe most difficulty in delineating specific goals, 
and find it almost impossible to employ experimental designs. 
Such programs have no clear and siiE?>le criteria of success 
and* benefit; without these, measures of effectiveness, or out- 
come measures, are impossible to determine, let alone quantify* 
Since this is overwhelmingly characteristic of child advocacy 
programs, it immediately precludes the establishment of an 
experimental design* Unless the researcher enters into the 
program at its inception and formulates goals, a situation 
which is recommended by some^ but rejected by numerous others^. 



/ 



such specificity is highly unlikely at the present time. Further- 
more, since the programs addressed by this study have already 
been initiated, such an approach Is not feasible even if It 
were desirable. 



^Cain and Hollister, in Rossi and Willi^, op>cit . ,p.ll2. 

^Rossl and Williams, op* citT^p. 17-18. 

/ 3 

-^Freeman and Sherwood, op.cit .. 

^Por example, Weiss and Rein, op. cit . 
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Second, vihen* Innovative social action programs were 
small-scale and circumscribed, evaluations were more easily 
designed. As programming became more national In scope. In 
particular, during the 1960s, the difficulties arose. As 
Weiss points out, "Programs may actually be no ^ore 
standardized In form, content, and structure thftn thfey ever 
were, but they are funded from a common pot and bear V common 
name,"-'" (For example. Community Action Programs, Headstart, 
Model Cities, legal services, neighborhood service centWs,) 
For the most part, this too Is tzne for community-based child 
advocacy programs, but It is further complicated by| the fact 
that they are funded by several different agencies within HEW, 
under the same label but with disparate theoretical, frameworks, 
goals, guidelines, W 

Third, evaluation Involves people and programs In ^ 
action. Randomization and the establishment of control "grotips 
are almost Inqposslble In puch situations. Furthermore', experl- 
mental, or even quasi-experimental designs Imply a stabilized 
treatment or program. When dealing with a phenomenon such as 
child advocacy, where there has been no agreement as to 
concept, practice or goals, and where programs have only 
recently been established and are still In flux, volatility 
and fluidity are far more characteristic than stability. 
Community action programs, of which' community- based child 

■'"Weiss, Evaluating Action Programs^ p, 328, 
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advocacy programs represent one form$ are rarely simple 

entities.' Weiss comments that such diffuse programs include 

a conglomeration of shifting activities that require enormous 

efforts' to specify and describe. Caro concurs, stating: 

In these settings. %)r\e evaluator must look 
for research strategies that are realistic andi 
at the same time, 3^$eld a maximum of useful in- 
formatiop. ^ Partlcrdlarly in the case of completely 
innovative programs vhere evaluation results are 
needed at an early stage, informal research * 
approaches usually associated with exploratory 
research may be most appropriate. Observational 
techniques and informal interviewing may provide 
more useful rapid feedback than can formal 
experimentation. 2 

Harris and Rein, among the earliest observers of social 
action, programs, stressed the inherent conflict between an 
action pro git^'^ and rigorous researcn. Quoting from-.a report 
on evaluation of a youth training projefct^ they note how 
imppssiW,e it is to be "inventive, flexible dnd expedient; on 
the one hand and a^ the same time to do carefxil, scientific, 
controlled research on the other. "3 

In addition., traditional > evaluation research assumes 
that the program is coippleted, something that is rarely 
characteristic of social action programs generally and 
certainly is not applicable to recently established child 
advocacy projects. 



Weiss, Evaluating Action Programs , p. 9. See also 
Brooks, op. cit" ^ ' 

Caro ^ "Evaluation Research," in Caro, op.cit » , p. 26. 

" -^Harris and-- Re in, op^cit . , p. 198. Rein, in the article 
written with Robert Weiss is the strongest critic of this 
Q approach and suggests an alternative which seems far more 
ERslC appropriate. 0CQ41 
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Fourth, practitioners are often antagonistic to 

r 

evaluations, seeing them as a potential threat. (A frequent 
"comment of project directors is, after all, "how often are 
^there positive results from evalxiation studle8?» Project 

/ staff may be preocci;?)led with survival Issues especially In 
the early months of operation, and evaluation of program out- 
comes seems unrelated to their immediate concern with continued 

. existence* Even where staff are prepared to cooperate, they 
frequently do not see Its relevance to their work. Short 
range feedback to Inqplrbve programming Is rarely provided by 
evaluators* Field experience reveals the frustrations of 
practitioners regarding elaborate studies which do not Include 
reference t9 the dally problems of program operation* vEven "\ 
completei^ studies of relevant projects are often unavailable 
to practitioners and certainly not J« a form which they can 
readily employ* It Is generally agre«d that eval^tlon 
research Is designed for utility, but such utility should be 
for both the project administrators as well as the decision- 
makers* Decisions regarding over-all program worth are 
crucial, though difficult to achieve; Interim decisions re- 
garding program Improvement may be equally Inqportant*^ 



^See Ouba and Sc riven vs* Rossi and Campbell in Weiss, 
Evaluatirig Action Programs > for contrasting positions on this 

issue* ^ ^ ^ 
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Other Problems of Current Evaluation Research 

Among the other criticisms of current research Is the 
failure to study the process by which prograjns become opera- 
tional, and how they Interact with their environment.^ In 
a recent report on the Parent Child Centers, Work comments 
on the lack of research focused both on process and organic- 
zatlon of these and similar progreuns. As pilot programs, 
they may be duplicated If their effectiveness is determined. 
He comments that "a greater understanding of how they have 
been organized, what should be done to improve thfem^%nd how 
the process of staff relations, staff -parent relations, staff- 
community relations, etc. can be carried out is essential. "3 
In the course of visiting several of these centers and inter- 
viewing program directors and staff. Work made it a point to 
ask how they would advise people in a nearby neighborhood if 
they wished to set up a Parent Child Center. He claims that 
he could obtain no response and concluded therefore that 
intensive study of this developmental process 'is essential 
if any form of technical assistance is to be provided for new 
program development. Related to this he suggests study of 
the structural variables of these prograjns: staffing patterns 

^Wei&s and Rein, op. cit . 

2 ' 
Henry H. Work, "Parent-Child Centers: A Working Re- 
appraisal \, American Journal of Orthopsychiat ry, XLII, 4 

(July I972I ^82-55^. ^ ^ 

(? 

^Ibld. , p. 590. 



36 



and their relationship to effectiveness; the role of the Policy 
Advisory Coiincll (every Parent-Child Center has one but Its 
function Is never clearly described and Its real role varies 
and often Is diffuse). He suggests further study of the role 
of participant groups In planning and the presence of such 
groups as a criterion variable. 

Regardless of whether evaluators favor the most rigorous 

form of controlled e;q>erlment or a softer design^ all recognize 

2 

that timing of evaluation studies Is crucial. Cain and 

Hblllster comment on the pressure for evaluating innovative 

action programs almost at thetr inception. They indicate 

how unrealistic this is since it takes time for any progrcon 

to become operational. They suggest that a "fair" evalxiatlon 

of a program can only be undertaken about two years after 

inception. Only then can one begin to anticipate sxifficient 

stability for evaluation purposes. 

Weiss also cautions eval\iators and people who fund 

jthem^ to avoid premature evaluation: 

New programs may fumble around searching for a 
rationale 9 a strategy of action^ and procedures 
of operation for quite a while, before they settle 
on course. Because of initial confusion, 
evaluation from the onset is sometimes premature. 



-^Work criticizes the National Evaluation Study of 
Parent-Child Centers, completed in 1971 by Klrschner 
Associates, saying that "a major area of evaluation that 
is seemingly missing is a comparlsdn of the various centers 
as to.thelT function, organizations and process." p. 591. 

^See Caro, "Evaluation Research," in Caro, op. clt . s 
p. 23; Freeman and Sherwood > op. clt .; Hyman and Wright, 
op. clt . 

3cain and Holllster, op. clt ., p. 13|. 
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In these cases it may be better to wait until it 
is clear what the program is.^ 

Shmelzer stresses that the problems of a new program are 

difficult to anticipate, and thus imply the need for an 

identifiable and accepted start-up period. As she says 3 

Many projects learn that the time required for 
implementing the demonstration has^ been under- 
estimated. Delays in recruiting and orienting 
staff, locating adeqviate facilities, and resolving 
initial operational problems affect program 
development. 2 

Considering the problems of evaluating programs with 
multiple goals, several researchers suggest evaluating 
particular elements or conqpojients rathei/ than the total 
progrcun. Weiss suggests that evalu^^!^ focus on one premise, 
one facet, one component, or one^^heory relative to a program. 3 
Such an approach when applied to a range of programs can pro- 
duce data of interest that would be useftil for future program 
developme^j^. (This approach is particularly applicable to 
this study which plans to focus on evaluating the most 
distinctive aspect of child advocacy programs, not their 
direct services, but rather their efforts at intervention on 
behalf of children into those services or secondary insti- 
tutions that impinge on their lives.)' 



iss. Evaluating Action Progreuns , Footnote 2, p. 9» 

2 

June L. Shmelzer, ed.. Learning in Action (Washington, 
D.C. : Government Printing Office, 1959/3 p. 2. 

3Weiss, ^'utilization of Evaluation," in Weiss, 
Evaluating Action Programs , p. 328. 
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Weiss and Rein also point out that the form assumed 
by broad-aim programs generally differs from community to 
community because of dlifferences in the needs and tolerances 
of .the communities."'' Although this statement inqplies the 
impossibility of standardizing treatment, and thus represents ^ 
an argument against more rigorous Studies, it also highlights 
the need to delineate bases for comparison through comparative 
study. 

Wholey, as mentioned earlier, recommends the elimi- 
nation of single project evaluations in favor of multi-project 

2 

studies. Weiss says that if one purpose of evaluation 
research is to compare the relative effectiveness of different 
program strategies, coinqparativd studies are .essential. 
Furthermore, although planned variations in program develop- 
ment are preferable, ^ 

conqparative study, even without consensus and' 
orderly variations, can have great power, rif 
the evaluator is clever he can capitalize on^ 
variations that occur naturally. Many govern- 
ment programs. . .are not so much unitary jJrograms 
as a congeries of diverse efforts addressed to 
the s&me problem. Within the program there are 
different emphases and different content and 
procedures. 3 

Tb^ evaluator may be able to categorize these different 
activities along a number of significarjt dimensions, relating 

' ■'"Weiss and Rein, op. cit .^ p. 239. 
"^Wholey, op. cit . 

3carol H. Weiss, Evaluation Research , p. 8I. 
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program types to criteria. , \ 

Amidon and Brim note that an6ther problem with evalu- 
ation research at present is that o^^ten academicians under- 
taking such study "do research consistefi^t with their theo- 

retical and scholarly interests but not remotely evaluative 

2 " \ 
of program goals." Furthermore, they are ten limited in 

their ability to carry out extensive field studies, because 

of insufficient familiarity with the field. 

Perman comments that good evaluation recjyires that 

the researchers have 

...extensive mastery of the options for action that 
are available in a given substantive area, and\must 
be able to reduce these options by the use of 
appropriate criteria. Many social scientists, 
although versed in research techniques, frequently 
lack the facility to make such Judgments. "3 

Caro, too, stresses that personal familiarity with action 

settings enhances the evaluator*s effectiveness in wording 

with practitioners. 

Finally, evaluation of social^ action programs has a 

particular proclivity for getting caught up in political 

conflicts. Methodology and design Have become the ground on 

which political differences are exposed and resolved.^ With 



■•-Weiss, "The Politicization of Evaluation Research," 
in Weiss, Evaluating Action Programs ^ p. 333. * . 

"^Amidon and Brim, op. cit . 

^Ferman, op. cit ., p. 153. 

^For an illustration of this, see Walter Williams and 
John W. Evans, "The Politics of Evaluation: The Case of Head 
Start," in Rossi and Williams, op. cit ., pp. 249-264. 
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so much at stake In both program and evaltiatlon. It Is no 
wonder that the results of research assume such Importance. 
Yet considering the competltlvene6s for resources the demand 
for Information about effectiveness continues unabated. 

The Need for Differential Evaluation 

Considering the haphazard development of child advocacy 
projects nationally, the lack of any consistent theoretical 
framework, the absence of clear or consistent goals, and the 
paucity of knowledge regarding processes or other criterion 
variables, the obstacles to evaluating such programs are 
almost overwhelming, yet the need Is equally great. The 
problem Is magnified by the fact that the projects were 
never designed as systematic experiments, but rather as 
random Innovations. Thus the major problem for evaluating 
these projects arises out of the need for employing a 
methodology valid under these kinds of circumstances. 

Although preference for experimental design for 
evaluation Is overwhelming, and It Is unquestionably con- 
sldered the Ideal design, the limitation and dlfflcxiltles dls- 
cussed earlier make such an approach clearly Inapplicable to 
child advocacy projects. Most researchers recognize the need 
for supporting the kind of Innovative programming these projects 
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repx*)ssent; at the same time, they recognize the difficulties 
such projects present for evaluation. There are several 
discafesions in the literature regarding the need for 
differential approaches to evaluation, even among the 
staunchest supporters of controlled experiments. Rivlin, 
urging more systematic experimentation in social programming 
states: 

this is not an argument for less random innovation. 
Indeed, we need more of it. If we are to understand 
the healing process, there is no substitute for 
support of creative people who are permitted to 
follow where their interests lead them. Moreover, 
even in the applied stage, the Initial development 
^ new methods and models cannot usefully be 
i^ematized. Someone with a new idea about 
teafeMng or health service has to work it out on 
his owfe^in one place, modifying it and making it 
operatiSn^ as he goes along. 1 

The issue, the re f^^3|j|^be comes how to evaluate the results of 

random experimentation /^satcorder to proceed to more systematic 

experimentation. 

Suchman, in his discussion of demonstration projects, 

argues that the state of knowledge regardiW these goals and d 

means for achieving these goals, requires a^ different design. 

He proposes that the research design be dirlctly related to 

the different phases and needs in the life-c^-cle of a program. 

Classifying programs as "pilot", "model" andf'prototype", he 

indicates that the variations are* time-relat«i, with the 

^Rivlin, op. cit . , p. 90. Cain and Hollister stress 
the need for "intentional experiments" (like Mvlin's systematic . 
experimentation) and like her criticize previous emphasis on 
natural and serial experimentation while recogrkzing its in- 
evitability. ^ 
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pilot program coming first. He describee the pilot program 

as representing "a trial and error period during which new 

approaches can be tried out on a rather flexible and easily 

' ^ revlsable basis* The emphasis In these programs should 

be on variation. 

Variation In the way the program Is organized. In 
how and by whom It Is carried out, where It Is 
^ located, whom It reaches, etc. Flexibility, 

Innovation, re-dlrectlon, reorganization are all 
desirable. . .Obviously, the pilot project requires 
"quick and easy" evaluation with primary enqphasls 
upon the ]Jfeedback" of results for program changes. 
This does not mean that success or failure are not 
to be Judged, but that the basis for such Judgpnents 
need not depend upon rigorous experimental designs. 
This pilot stage Is one of exploratory research and 
the main objective Is to learn enough to be able to 
move fiJiead to the development of a program which ban 
then be evaluated In a more systematic manner. 2 

Suchman suggests that surveys or case studies are the most 

appropriate design for this phase. The early developmental 

phase of all the projects Included In this study, the specific 

Inclusion of several demonstration projects and the analogous 

X situation of several others (early efforts at Innovation in 

programming, the limited knowledge regarding goals and 

processes) highlight the relevance of Suchman *s approach. 



Isuchman, "Action for What?" In Weiss, Evaluating 
Action Pro-ams > p. 6o. 

2lbld. , pp. 60-61. 
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McDlll suggests that where existing research does not 
©how what works and what does not work, evaluation research 
needs to learn from innovative project? that appear to. have 
been successful The authors recommend that locally-based 
projects be funded and staffed with project directors "who 
might be long on ideas and experience but short on methods 
for Justifying the ideas." They argue that there is a high 
level of risk involved in such programming, but assume that 
through this "trial and error" approach to experimentation, 
successful projects could be identified and then subjected 
to more rigorous study. Along these lines they recommend 
a triplfe approach to project development: 1) a small group 
of experimental projects, rigorously studied; 2) a small 
group of high risk projects, initially free of rigorous 
evaluation; and 3) a large majority of projects somewhere 
in l^e middle, whose evaluation would vary depending on the 
nature of the project; such an approach would include field 
studies, ex post facto design, longitudinal studies. ^ 

Rossi points out that while controlled experiments 
are the most powerful devices available for evaluation 
research, they are often difficult to Implement in the context 



^Edward L. McBill, Mary S. McDill and J. Timothy Sprehe, 
"Evaluation in Practice: Compensatory Education," in Rossi 
and Williams, op. cit. , pp. l4l-l85« 

^Ibid ., p. l8l. ^ 

3a1 though McDill, et al address the need for a variety 
of approaches to compensatory education, their approach has 
relevance for social action programs generally. See chart 
O on page l8l. ^ , * 
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of action programs, for the reasons mentioned earlier. He 

states that such an approach is more feasible for specific 

aim prograjns because 

the more -.specific the goal of the program, the ^ 
more consensus there will be among decision 
makers, researchers, and prograjn administrators, 
in the measures that can be taken as signs of 
the failure or success of the program.! 

Thus rigorous evaluation of OEO family planning 

programs can be implemented because the reduction of births 

in- the target population is a clear, specific agreed upon 

and measurable outcome. He comments further that where 

broad-a^rh programs are concerned (e.g., anti-poverty, 

Headstart, child advocacy) program "monitoring" becomes 

2 

the "first step in a graded series of vested researches." 
Once the more effective programs have been identified, 
more rigorous techniques can be employed. He concludes 
by saying thlat "at this point it seems Utopian to expect 
that we will ever have^ experimental designs measuring the 
, Impact of Title I programs or Model Cities."-^ He delineates 
two phases in the development of a usefiil strategy for 

♦ 

.evaluation research. First a "reconnaissance phase" - 
a rough screening process in which a soft research design 
identifies- specific projects and/or types of programs 
worth further Investigation, and 



^Rossi, Rossi and Williams, op. cit. , p. 44. 
^ Ibid. , p. 44. 
^Ibid. , p. 44. 
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second, an "experimental phase" In which powerful controlled 
experiments are used to evaluate the effectiveness of those 
programs already demonstrated as worthwhile.^ 

Both Sucbman's concept of relating^he research design 
to the phases in the -life cycle of a pr6Ject, and Rossi's 
dual strategy of . evaluation - with "soft" approaches employ- 
ed when evaluating broad-aim programs - have particular 
relevance for this study. However, further delineation of 
the methodology to be employed follows from the stance taken 
by Weiss and Rein. Recognizing the titility of {experimental ^ 
design for specific aim programs, they are strongly critical 
of the approach when applied to broad aim programs. They 
argue that the multiple objectives, strategies and evolving 
nature of such programs require a process-oriented . quali - 
tative and historical approach to evaluation. 

They focus on the need to understand- the process of 
development, adaptation an^ effect. Instead of emphasizing 
whether^or not a program works, they stress the need to 
discuss what happens when such a program is introduced. 
They outline a more effective methodology as follows: 



Ipeter H. Rossi, "Practice, Method, and Theory in 
Evaluating Social Actipn Programs," On Fighting Poverty , 
ed. by James L. Sundquist (New York: Basic Books, 19^9), 
P^ 232. 
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First, a more effective methodology would be much 
more descriptive and inductive. It would be con- 
cerned with describing the unfolding form of the 
experimental intervention, the reactions of 
individuals and institutions subjected to its 
Impact, and the consequences, so far as they can 
be learned by interview and observation', for these 
individuals and institutions. It would lean toward 
the use of field methodology, emphfi^sizing intervJLew 
and observation, though it would not be restricted 
to this. But it would be much more concerned with 
leaining than with measuring. J- ♦ 

They characterize this methodology for evaluating 

broad^aim programs as 

bl) process oriepted qualitative res'earch as 

b) historical x*esearch, or a 

c) case study or comparative research^ 

Although Weiss and Rein recommend either an individual 
case study or a small-scale comparative study, a- varlatio^i 
on this approach, combining a process orientation and Rossi *s 
concept "monitoring" - but stressing c'bn?)arative study - 
has already been, implemented by OEO."^ ^ 



-"-Weiss and Rein in Cat^o, op. cit ., p. 295. 

2we iss and Rein in WeiBs, Evaluating Action Programs , 
p. 243. One current evaluation employing zhe approach is 
Kaplan, Gans and Kahn*s study of service integration projects. 
This study is still in prqcess. It was hoped that som6 
intermediate reports would be available for analysis as to ' 
its relevance for this study, however, no reports Wer^ :forth- 
coming thus far. 

^Qnploying field interviews, observations, etc., this 
study, directed by Vanecko, congpares 50 community action 
progreuns classifying them into those, which emphasized citizen 
organization (organizing and mobilizing the poor) and those 
which emphasized the coordination of existing agencies and 
services. V^ineclco concluded that the former produced more 
in the .way of increased services for clients than the latter. 
J. J. Vanecko, "Community Mobilization and Institutional 
Change, " Social Science Quarterly , L, 3 (1969). 



R6s*l, Weiss- and Rein rejate th§ need fol* differential 
approaches for evaluation to the "type of program as deter- 
mined by the nature of the program goals (speqified aim vs. 
broad-aim programs), ^uchman relates his me^tJfcd to thl^g, 
as well as to the" stage in J^e life^cycle of a program. How- 
ever,, he implies that programs bltb^ discrete entities, repr*- 
senting each phase in the cycle (e.g., pilot, mo<i^ or proto- 
type progratm). Alkin, Freeman and Sherwood focus on the 
planning process which leads to m&king prograjtis operational. 
For example, Alkin identifies five types of evaluations 
related to^ attempts at providing information for different 
kinds or levels of decision making."^ 

1) systems assessment (this involves a kind of 
exploration phase and delineation of the tasks 

^ to be addressed, problem to be solved, goals 
to be achieved) / \r ^ 

2) program planning (consisting of information \ 
gathering relevant to the selection of alternative 
progreims oi^ strategies) ^ 

3) program implementation (this consists of provid-^ 
ing information relative to the extent to which a 
program is doing what it proposed to <Jo (and/br 
says it is doing) to phe groxap for which it was 
intended' ^ * . ; 

^) . progrcun Improvement (the feedback of information 
to the progratm to correct errors or effect some 
change in it) 

5) program certification (providing information that 
might be us^d by decis.ion-makers in njaking Judgments 
about the worth of a program, and' its potential 
generalizability to other related situations) 



■'■Although Alkin is concerned with education, his 
approach is equally applicable to other types of action 
programs. Alkin, ,in Weiss , - Evaluating Action Programs ^ p. 199. 
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Although Freeman and Sherwood are among the most ardent 
stqpporters of rigorous experimental research, their dellne- 
ation, of the different tasks faced by prdgj*am implies the 
need for . diff«rential evaluation related to these tasks. 
.They sub-divide the work of m project into planning, develop- 
ment, and execution, with evaluation occurring only at the 
end. . They acknowledge that ^separation of these tasks is 
som^hat arbitrary and artificial and that there is a level 
of interdependence between and among them yet state that 
evaluation "cannot take place when planning and program 
develoggjfent have not been thoroughly undertaken. They 
delineate the tasks to include: — 

1) Planning (setting goals, assessing existing 
conditions, developing strategy). 

2) Program development and inqplementation 
(selecting target population or targets, 
target area, and designating a i^ogr^m 
model). 

3) Evaluation. 

Implicit in the above is that if evaluation is to occur after 
the appropriate task^ are completed, some ordering and "timing 
of these tasks are essential; assumptions regarding the com- 
pletion Of these tasks should be based on collected infor- 
mat ion; evaluation that is perfor^d at the planning stage 
would have to involve different criteria (and methodology?) 

2 

than evaluation after the program in^lementation Is conqpleted. 



1 * 
Freeman and Sherwood, op# cit . , p. 83. 

^Ibid . > pp. 3-15. 
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Wholey delineates four types of evaluation:''' 

1) program impact (assessment of the over-all 
effectiveness of a national program In achiev- 
ing its objective, or of a small' group of 
programs, in meeting their common objectives); 

2) program strategy (assessment of the relative 
effectiveness or different techniques used in 
a national program); 

3) project evaluation (assessment of the effective- 
ness of an individual project in achieving its 
stated objectives); 

4) project rating (assessment of the relative 
effectiveness of difj^erent local projects in 
achieving program objectives); 

5) monitoring (as distinct from evaluation, assesses 
the ipanageriAl and operational efficiency of 
programs and focuses on inputs rather than outcomes). 

Wholey urges that the federal government no longer 
commit itself to evaluating individual projects, but rather 
concentrate on national programs with multiple projects, or 
at least a group of projects. . He urges the collection and 
analysis of data on comparable programs and suggests that if 
local evaluations are required of local projects, the govern- 
ment provide funds and technical assistance to implement such 
studie?. V 

Glennan describes three tjrpes of evaluation research, 

2 

as defined in the OEO instruction manual: 



•^Wholey, et al, op. cit ..^ pp. 25-27. 

# 

2 

Thomas K. Glennan, Jr. , "Evaluating Federal ^4anpowe^ 
Programs: Notes and' Observations", Rossi and Williams, op.clt . 
(3 pp. 187-220. ^ • 
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<^ Type 1 : 

The over-all assessment of the impact and effective- 
ness of a national program, in order to determine the 
?illocation of resources and implement planning. i?or 
the most part these should be cost/benefit studies, 
done by the federal govemmerit. 

Type II ; 

Evaluation done for immediate feedback; it relates 
to the identification of differentially effective 
program gtrr^ , ' - 

Type III : 

Monitoring . 

Although Glennan does not use the terminology 

"summative" and "formative" , evaluations, his description of 

Types I and II closely resemble these categories, as they 

are defined by McDill: 

Summative (assessing the Impact of the program at 
the global level); formative (focusing on local 
efforts to isolate effective strategies which could 
be used to Improve national efforts); and monitoring 
(periodic "custodial" assessments of local programs 
to determine that minimum federal guidelines were 
being followed .1 

Relevant to this distinction between summative and formative 



evaluation, both Glennan and McDill criticize the Westing- 



house Heads tart Evaluation for focusing solely on the global 
impact of the program at the national level rather than on 
the different; ial effectiveness of local centers. The^ 
importance of formative evaluation studies is also discussed 
by Stake, who relates this to studying the early developmental 
stage of project development, and stresses the importance of 
this for planners and programmers. 



McDill, Rossi and Williams, op> cit >, p. l64. Footnote. 
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Scriven, who appears to have been the first to note 
this "distinction between formative and summative evaluation 
states that evaluating stable and fully operational programs 
is very different from evaluating newly established programs 
that are still in flux.^ He suggests that formative evalu- 
ation is designed for the latter group to help them improve 
and aid development, while summative evaluation is designed 
to appraise a well-established program. He concludes that 
different research designs, measures and time schedules are 
required for each type. 

Finally, another approach to differential evaluation, 
that of Tripodi, Fellin and Epstein, is particularly relevant 
to this study. ^ The authors identify three stages of program 
development: 

1) Program initiation , the first phase of program 
de ve lopme n t , r e f e r s to the whole planning 
process and consists of determining the need 
for the program," specifying goals, processes, 
structure and strategies; identifying targets; 
obtaining funds; hiring staff. 

2) Program contact involves the development of , 
constituencies and target populations and/or 
organizations; identifying aids or obstacles 

to the implementation of a program. 

3) Program In^lementation is the fina^ stage of 
program development and in^lies that the 
program is fully operational. In this stage, 
services are provided and interventions or 
change technology applied. It is only at 
this stage that program outcomes can be 
identified and measured. 



■'"Scriven in Weiss, op^ cit > 



/ 



^Tripodi, FellihNmd Epstein, op. clt . , Nghapter II, 
"Program Development", pp. 25-^0. ' J 
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Basic to their approach to evaluation is a strategy 

of differential evaluation which they define as: 

a process of^^asking different evaluation questions 
of program efforts, effectiveness and efficiency 
for each program stage of development, and then 
. choosing those evaluation techniques which are 
most appropriate to the evaluation objectives.^ 

Their recognition of developmeni^al stages in the life cycle 

of social action programs, and the explicit design of 

differential criteria for eftch of^ these phases, seams 

particularly relevant for this study. 



orgctizationaL theory as it relates to program 

The case for a dif feWntial approach to evaluation has 
been argued; the issue now is how to delineate the stages by 
which a project develops, in order to seek out and identify*^* 
evaluative criteria for each atage» Considering the fact 
tJbat child advocacy projects appear to be addressing a newly 
defined need, that of intervention in institutions Impinging 
on children's lives, they tend to be new and at least in part, 
innovative* Systematic knowledge about how they are initiated, 

... / 

develop and become operational does not yet exist. Thus, the 
process must be first studied empirically, relevant data 
collected and analyzed, before any developmental stages are 
positively identified* 



However, while they employ different vocabularies and 
degress of refinement, there are several studies of organi- 



O -^Ibid. , p. 12. 
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zational development and change that offer possible frame- 
works for viewing this process and some guidelines for con- 
ceptualizio/g it. Although in practice there may be some*" 
interconnection 'and overlap, these stages tend to be defined 
as discret^e, in order to provide analytic categories within 
which one can approach a study of the developmental process. 
• Two such conceptualizations seem particularly ueeful 

for the purpose of this study. The first, that of Lawrence 
and Lorsch, suggest 'five stages of organizational develop- 
ment : 

1) Diagnosis , involves Identification and 

anaiycJs of the problem or need and Includes 
'organizational, environmental and related 
factors ; 

P.) I^eslgn Includes the establishment of an 
organizational structure and de]|!^neat Ing 
Objectives; iT 

3) Action-Planning^ Involves the development of 
alternative strategies and change methods for 
achieving the desired objectives as well as 
planning the sequence and timing of action 
steps; 

^) Implementation is the phase in which the 
action plan is translated into action; 

5) Evaluation is both the last step in the 

organizational development sequence and the 
first phase of a new cycle. It consists, 
again, of coftiparing planned goals with actual 
results and diagnosing the variance of its 
causes. 

Hage and Aiken identify four phases in program develop- 
ment: Evaluation . Initiation . Implementation and Routinization.^ 
^ 

^Paul R. Lawrence and .Jay W. Lorsch, Developing Organi - 
zations: Diagnosis and Action (Reading, Mass.: Addison-Weslev 
Publishing do., 1969), p. ^1. 

2 

Jerold Hage and Michael Aiken, Social Change in 
O Complex Organi zations (New York: Random House, ly/'U), pp. 92- 
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They employ the term "evaluation" to describe the process by 
which a situation, problem or need Is studied, diagnosed 
■ and assessed. In effect, what Is the need-.£or change? What 
are the objectives? (Lawrence and Lorsch actually do the 
same when they employ evaluation as the final phase In the 
developmental cycle; It Is also the first phase of a possible 
new cycle, for example, initiating a new progreim if a new 
need or problem arises). 

The second stage, initiation, involves designing the 
n^w prograto. It includes a search for solutiono 'to the 
problem or need identified, the -preferred choice among al- 
ternative solutions, and the search for resources, both 
financial and human to pay for the proposed plan. 

The third stage. Implementation, involves the actual 
attempt to start a new activity. Here, the change plan that 
has been designed and developed in stage two, is put into 
action; the program becomes operational. 

Finaaiy, the fourth stage is that of routinization, 
and involves the stabilization of the program. This implies 
achievement ot objectives, and yihe complete integration and 
instltutionaliaation of the pogrom. 

They note that although these stages do overlap, 
successftil completion of each is dependent on the success of 
the previous one; ^nd that all except the final stage involve 
conflict. 

A A A P. 0 
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OTHER RELEVANT LITERATURE 



Kahn's theory of social planning provides anott 
conceptual framework within which one can analyze the ^ocess 
by which projects develop.-^ His concept of planning bemns 
with the Identification of planning Instigators, the ex^ora- 
tlon of "the relevant aspects of social reality and the 
preferences of the relevant conununlty, and a definition %f 
the planning task. This Is analo^^% to the diagnostic st|^^ 
described by Lawrence and Lorseh, or the evaluation stag© o^ 
Hage and Aiken. In essence. It included som^ reeognftlon of^ 

\ 

problem or need, an assessment of relevant values and envlron- 
mentSU factors, and a delineation of objectives. Policy 
formulation is defined by him as "the general guide to action, 
the cluster of over-all decisions relevant to the achievement 
of the goal, the guiding principles. "3 The action planning 
or Initiation phases described earlier Include policy formu- 
lation as an essential component, although they overlap with 
Kahn's programming phase. However, since in Kahn's paradigm, 
the stages of planning are Interconnected, Interdependent and 



-^Alfred J. Kahn, Theory and Practice of Social Planning 

' - ."m^. — ^ 



(New York: Russell Sage 
^ Ibld > , p. 61 • 
3 Ibid . , p. 131. 
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overlapping, this is inevitable. Again, evalixation described 
as an on-going part of the planning process, also implies a 
potential for each phase being evaluated, albeit by different 
criteria. Thus, that stage of program development in which 
tasks are defined (and goals and objectives delineated) could 
be evaluated along different criteria than the stage in which 
policy is formulated and alternative approaches to prograjmning 
considered. 

As discussed earlier/ relevant discussions of the 
inadequacies of evaluation research indicate the need for 
Gtudies of the processes of project growth and development 
and the need for comparative studies. Saraoon points out 
that all exlQtlng studies of organizational growth and develop- 
ment deal with mature organizations."'" He points out that In 

a major work on organizational theory and organizational 

2 

development, no article deals with new, emerging organi- 
zations. There ^re no studies of the problems of immature - 
young or neVr organization6 or projects. He stresses the need 
for empirical studies describing how such organizations are 
created and how they develop. 

In his discussion of organizational development and 
growth, Starbuck criticizes existing research for substituting 

^Seymour B. Sarason, The Creation of Settings and the 
Future Societie s (San Francisco: Jossey-Bass, Inc., 1972). 

2james G. March, Handbook of Organizations (Chicago: 
Rand McNally, I965). v 
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theorizing for data colle^ction and presenting ^ata withc^ut 
adequate analysis.^ He states that: 

At this point what is needed more than anything 
else is data - data on goals, data on behavior 
strategies, data on structural variafcrles, data 
on nes^rly every aspect of organizational growth ' 
and development.^ 

The collection of such data is essential in order to provide 

a basis for working towards any development of theory and can 

only evolve from case studies of individual Organizations as 

well as comparative studies of multiple organizations. 3 

Udy as well as Starbuck urges such con^arative studies, 
suggesting that only through comparative analysis can any 
attempt be made to establish general principles about organi- 
zations.^ He suggests that many different approaches can be 
employed since some researchers compare two organisations 
while others compare 200; some employ statistical techniques 
while others do not. He identifies the central issue in such 
a study as "What" is the researcher trying to do? How is he 
trying to do it?" 

Where the "what" is discovering the interrelationship 
between variables or cons-^jant characteristics of all organi- 



^Willaim H. Starbuck, "Organizational Growth and 
Development," in March, op. cit ., pp. 451-533. 

^Ibld. , p. 519. 

o 

-'See also, Barney G. Glaser and Anselm L. Strauss, The 
Discovery of Grounded Theory; Strategies for Qualitative 
Research (Chicago: Aldine Publishing Co. , 1967). 

^Samuel H. Udy, Jr., "The Comparative Analysis of* 
Organizations", March, op. clt . , pp. 678-707 

Er|c 0C0G5 



58 



J 



zatlons (e.g., the pattern of development), the "how" is 
more likely to be an exploration of data in order to make 
some sense out of it rather than testing hypotheses."^ He 
concludes 

In summary one finds a rather wide variety of 
procedures in common use in comparative organi- 
zational analysis. This yariety stems partly 
from lack of knowledge of the nature 6f exploratory 
research; current needs of the -*leld suggest an 
emphasis on the development of such knowledge, 
since exploration appears to be much more 
pertinent to comparative organizational studies 
at present than does hypothesis testing. 2 

other studies have relevance^ for certain policy issues 

addressed by the proposed study or confirm the need for 

comparative studies and case studies of conmiunity programs. 

Kahn's distinction between case Jind policy advocacy,^ and 

k 

Briar's between client and group advocacy are helpful in 
clarifying the base from which inteirvention into or with 
institutional networks on behalf of children proceeds. 
O'Donnell's study of nei^borhood service centers offers 
perspective on the nature of community-baged multi-service 
centers generally, and highlights an issue relevant to child 
advocacy al80;whether such projects can encompass both a 



■^Ibid. , p. 680. 
^ Ibld . . pp. 686-687. 

^Kahn, Theory and Practice of Social Planning . 
Briar, op. clt . 
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social action component as well as a direct service one. 
Litwak's studies of organizational factors and social control 
in the coimnunity relate to the issue of how, under what 
conditions and around what issues community primary groups 
(of which community-based child advocacy projects are an 

2 

illustration) can intervene in bureaucratic organizations. 

Kramer's study of 'five community action programs 
illustrates the use of a comparative case study approach (the 
approach that ydll be utilized in this study) for describing, 
analyzing and evaluating community programs.^ In addition, 
the purview of this study is not the total scope of community 
action policy and program but rather what he defines as the 
"most distinctive aspect" of the community action progitam. 
Similarly, thlG otudy will focus on the^m^gt distinctive 
aspects of child advocacy projects, their advocacy activities. 



^Edward J. O'Donnell and Otto M. Rfeid, "The Multi- 
Service Neighborhood Center: Preliminary Findings From a National 
Survey", Welfare. in Review , IX, 3 (May/June, 1971) 1-8; 
O'Donnell and mrilyn M. Sullivan, "Seirvice Delivery and Social 
Action Through the Neighborhood » Center :^ A Review of Research", 
Welfare in Review , VII, 9 (November/December I969) 1-^2; See 
also. Grosser, Helping Ycath: A Study of Six Commxinj^ Organi - 
zation Programs , (Washington, D.C.: U.S. Dept. of lieaith. 
Education and Welfare, I968); Ralph Kramer, Part icfipat ion of the 
Poo^: Comparative Community Case Studies in the wgr^6n Poverty, 
( Engl ewood Cliffs, N.J. : Prentice-Hall, Inc., 19t>9). 

3ee, for example, Eugene Litwak, "An Approach to Linking 
in 'Grass Roots' Community Organizationb'' in Fred M. Cox, et al, eds. 
Strategies of Community Organization (Itaska, Ill.r.F.E. Peacock, 
Publishing Co., 1970). " 

^Kramer, op, cit. ; Grosser, Helping Youth . 
4 

Kramer, op. cit. , p. 21. . 
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Finally,, discussions of* field Investigations and case 
studies, abound in the literature. Such an approach has been 
defined as ^ 



the observation of people in situation, if by 
'observation' is meant any and all of the 
techniques by means of which social investigators 
gather their data. 4. such diverse methods as 
interviewing, observation and the analysis of 
documentary materials ojr other groups products 
may be utilized, ^ 

Field studies may include studies of individual cases 
or multiple casQs, or a community. They may be longitudinal 
or comparative jpr a combination of both. They may Involve 
either sustained participation by the investigator, "a short- 
term, more transitory participation, or a combination of both. 
Although the sustained approach is recommended for descriptive 
or exploratory ©tudies, this recommendation is based in part ^ 
on the time needed to eetablieh a working relationship with ^ 
the group or groups being studied, ' Where this study is 
concerned, such a relationship has already been established. 
In addition, most of these projects have already' been y^^teQ 
either by this investigator or an associate, at least on^ie 
within the past year, in the course of the earlier study. 
^ ^ Thus the Suggestion for sustained participation In the course 
of this study seems less essential. 3ummarizlng the need and 

Freeman and Sherwood conclude 



Iw, Richard Scott, "Field Methods in the Study of 
Organizations"^ in March, op. cit . , p. 262; see also, ^George 
A, hcCall and J, L, Simmons, issues in Participatant Observation , 
(Reading, Mass.: Addison-Wesley Publishing Co., 19b9), 

^Scott, op. cit. , pp, 267-68, 
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We do not have enough Information about how the 
various health, education and welfare organizations, 
as well as persons in them actually operate. What 
policy makers think professionals and specialists 
dcJ is* of ten very different from what they actually 
do,t. Extensive and continual field investigations 
are required • This is an area of social policy 
research that clearly is undeveloped. 1 

Finally, reference to current evaluation studies of 

existing child advocacy projects and any internal evaluattions 

of programs, will be referred to as relevant, in later chapters, 



"'■Preeman and Sherwood, o^, cit . 
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CHAPTER III 
STUDY METHOD: THE FIRST PHASE 

GENERAL SCOPE ^ APPROACH AND PURPOSE OF THE STUDY 

The last chapter delineated the need for a 
differential strategy for evaluating sociaJ. programs. In ^ 
each case tHe approach taken should be related to the par- 
ticular type of program - broad aim - research and demon- 
stration - as well as to tke phases of program development 
at the time of eva,luation. Some alternative approaches to 
classifying these st&ges 'were identified and will be dis- 
cussed in greater detail in Chapter V. Also noted was the 
need for comparative study of a number of such programs in 
order to describe how projects develop, to determine whether 
or not there are recognizable patterns of growth ahd to de- 
velop indices ^for classificfi^'tion of projects by developmen- 
tal stage at the point of ^ evaluation. Through such compara- 
tive fimalysis, criteria for evaluating each phase might be 
developed empirically. 

Considering the problems related to evaluation gen- 
erally, and the paucity of knowledge regarding how new pro- 
jects begin and develop - in short, given the lack of cer- 

-n 

talnty eis to what is the norm ajid what is idiosyncratic - 
this study had to be essentially exploratory and descriptive. 
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It sought to develop a relevant approach to evaluation even 
if it had to he new and different. The difficulties, in- 
appropriateness and unfeasibility of an lekperimental design 
were discussed in the previous chapter; the case for a pro- 
cess oriented, qualitative approach to evaluation was out- 
lined there also. The latter approach was suggested as the 
desirable ^^ternative, and is the approach utilized in the 
present study. Included were a combination of site visits, 
interviews, direct observation, intensive field studies and 
review of relevant program materials. All these efforts were 
addressed to two major purposes: 

1) to identify, describe and analyze the phases through 
which community-based child advocacy projects pro- 
ceed from inception to implementation; 

2j/to determine what the criteria for successful devel- 
i! opment might be at each iJhase and how such criteria 
might be formulated. 

Pre -structuring the design for evaluation assumes 
botht,data and knowledge of criteria; as indicated in Chap- 
ter I, neither of these was available for child advocacy 
projects. Elsewhere, it has been suggested that in order 
to discover what concepts and hypotheses are relevant for 
the area one wishes to study, one must do an analysis of 
comparative data obtained from systematic empirical research 
and develop the theory ind\:y^tively rather than deductively. 1 

^See Glaser and Straus, o£. clt . , for an over-all 
description and analysis of this approach; Sarason, op. cit. 
Stanley Cohen and Laurie Taylor, Psych ologicjal Survival ; THe 
V Experience of Long Term Tmnri snnmpnf. / M^u, v^r.v. Books, 
1972), represents an illustration of a partial application of 
the approach, 
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Following this approach, this study proceeded to develop 
its methodology empirically rather than theoretically, one 
step at a time. In this manner, the method evolved as the 
data were colles^cted and analyzed. 



SAMPLE COMPOSITION, SIZE AND SELECTION 



The universe of child advocacy projects from which 
a' satyle of community-based projects, was selected, was de- 
fined as follows: all programs identified as child advocacy 
projects through the national survey completed by the Child 
Advocacy Research Project in 1971-72. Other criteria for 
selection were: 

1) that the^project selected ba explicitly labeled 
"child advopacy"; either that child advocacy be 
part of the name of the project; that it, have been 
defined as such by the funding source; or that it 
be self -defined. 

2) that it be a project for which there are baseline 
data available from the 1971-72 study so as to 
assure a longitudinal view (questionnaires, inter- 
views, and/or case studies). 

3) that the project be community-based, ^'oramunity- 
based is defined to mean that the primary target 
area identified by the project be either "neighbor- 
hood," "specific catchment area," or "community" 
(the latter defined to mean a small dty or circum- 
scribed geographic area with a population of less 



Additional and interesting child advocacy projects 
were identified subsequent to this survey. HoWever, absence 
of baseline data for these projects precluded their inclusion. 
Similarly, some projects which were included in the initial 
study, pro'^ed not to be valid child advocacy projects after 
study and observation. This latter point will be discussed 
again in Chapter VI. 
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4) that the project' appear to meet the definition of 
child advocacy adapted after the initial study 

, and endorse(^ by OCD. ( "intervention on behalf of 
children in relation to those services and insti- 
tutions impinging on their lives"). 

5) that the project be operating currently and have 
been funded at least six months prior to the be- / 
gifining of this study but no more than two and 
one half years earlier (between March, 1970 and 
March, 1972). The decision to limit thWge of 
the projects was taken to ensure that.=.*ft^ had 
some "life experience" to study (at least si3f 
months old) ; but were not so far along chronologi- 
cally as to make any retrospective recall of their 
initial experience impossible.- (It was not known 
then that this criterion eliminated most projects 

that were fully operational!) ' ^ 

From the universe of 103 operating "cTiild advocacy 
projects for which baseline da*ta were, available^, thirty- 
seven projects were identified as comraunity-based3. This 
was the largest single category of projects, representing 

about one -third of the total universe.^ Two projects were 

_;i . 

■'■For definition of "community," see Roland L. Warren, 
The Interorganizational Field as a Focus for Intervention," 
in Fred M. Cox, et. al . , eds.. Strategies of^mmunity 
Organization (Itasca, 111.: F. ii). Peacock Publishing Co,, 1970); 
irvmg A. Spergel "Community-base;! Delinquc/ncy Prevention 
Progranft: An Overview,"- Social Service Review, Vol. \l , No. 1. 
March 1973, pp. 16-31, eipicTally pp. 1 7-18. . 

2 

Kahn, Kamerman, McGowan, o£. cit. 
^IMd. , p. 53. 

/ ^There was some eventual overlap between cortiraunity- 
based and city-based, in particular whpre small cities des- 
cribed themselves as "a community" or a single catchment area. 
The actual breakdown was 30$^ neighborhood; 20^^ state-based- 
19^ cotinty-based; 195^ city-based; 12?^ national. 
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eliminated because. In their response to our mall survey, 
they described their program as direct service only, with 
no advocacy component and no effort at Intervention or change 
(n other Institutions for either Individuals or groups of 
children. Two more projects were ej^lmlnated because they 
were not operating at the time this ^tudy began. Four 
projects were eliminated because they were begun prior to 
March, 1970. Two more were eliminated when the funding 
a^jency €uid *the project directors announced - prior to the 
onset of this study - that the projects were Inappropriately 
labeled child advocacy and were not designed to provide ad- 
vocacy In any fashion, / 

. Thus, the universe of commiinlty-based child advocacy 
projects meeting the specified criteria was reduced to twenty- 
seven projects. Of these, two were eliminated because of 
the limitations of the.stuc^y's travel budget (one pro feet 
was In Alaska; the other In Hawaii), One was excluded be- 
cause -o'f the difficulty In fitting It Into scheduled field 
visits; and one other because two attests at reaching the 
project were aborted because of weather conditions. However, 
with regard to these last two proje'cts, both were Parent- 
Child Center-Advocacy ProJejCts. Since the remaining sample 
of twenty-three projects Included three others designed to 
follow the same model, failure to Include these two woxUd not 
appear to have biased the study. tSb final sample of twenty- 
three community-based child advocacy projects studied with 
reference to the "phaslng-ln" process, does not appear to be 
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subject to any recognizable bias. 

The projects studied are located in foui\teen dif- 
ferent states and twenty cities. When approached all agreed 
to participate in the study .and all except one were visited 
by the researcher personally. (For further details and a 
general descriptive overview of the projects see Chapter IV.) 
For sixteen projects, supplementary data were available from 
among the case studies in the original study. Of these stu- 
dies, four were completed by the present researcher and twelve 
by another stdff member. 

DATA COLLECTION 

The study began with the development of a semi- 
structured interview guide (see Appendix) focused on ques- 
tions related to the phasing-in process of these projects 
and influenced by the experience of the 1971-72 study. Al- 
though initially it was anticipated that all interviews would 
be t^pe recorded as they occurred, the discomfort of the first 
three interviewees and their request that interviews not be 
taped led to the elimination of this approach. Instead, ''ex- 
tensive notes were made during the interviews. These notes, 
combined with personal observations and documentation by 
written progress reports, minutes of board and staff meetings 
and other related materials, provided substantial support 
for recalling interview content. Detailed reports of all 
interviei^s were dictated within a maximum of twenty-four hours 
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after the visit and were subsequently analyzed and summarized 
both chronologically (in order to depict the actual life 
history of the project) as well as topically. 

Site visits were made to twenty-two projects between 
October l6th euid December l4th, 1972 and an extensive tele- 
phone interview was held with the staff of th^ remaining ♦ 
project in January of 1973. Most of these visits involved 
an entire day; no interview took less thatn three hours. The 
Interviews were held with project directors and on occasion 
several staff members^ In severed of the projects, t^hree or 
more staff members were interviewed in addition to the pro- 
ject directors. Wherever possible, in projects where formal 
propo||als had been developed, interviews also were held with 
the people who developed the proposal. 

As the appendix copy of the gxiide indicates, these 
interviews inquired about subjects such as the following: 

- What was the background of the program? How long 
was the proposal in formulation? Who developed the 
proposal? 

- When was the project funded? What was the source 
of funding? How were the funds channeled into the 
project? What was the size of the budget? How 
and by whom was fiscal control exercised? 

- What were the organizational structure, auspices 
and staffing patterns of the program? 

- When were staff recruited €uid hired? By what means? 
How long did it take? What was the nature of their 
training? 

- When was the board selected? By what means? How 
long did it take? 

- What action targets were first identified? When? 
By whom? ^ ^ 

0CCV6 
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- What was the nature of the current program and 
its operational status? What were examples of 
current activities and when were these ini- 
tiated? How did these compare with what was 
projected in the proposal and at various inter- 
mediate points? 

After the first five projects were visited, data ob- 
tained were analyzed and the interview guide refined further. 
The major changes made were: to avoid the obvious use of the 
guide during the interview; to decrease the number of ques- 

0 

tions po3ed directly; and to encourage all interviewees to 
"tell the story of the project from its beginning to the 
present." This approach was employed with each staff member 
in a separate interview. Different perspectives were followed 
up later. Sometimes differences were resolved by written 
reports and dociomentation; sometimes in further disc^ssi<^; 
sometimes they were unresolved.-^ The interviewer posed 
direct questions only to clarify, to probe or to obtain needed 
information that did not flow naturally. 

As indicated earlier, case studies had lieen made of 
sixteen of the twenty-three projects in the sample as part of ..^i,^)^ 
the 1971-72 study. In these, data obtained covering the pre- 
vious year's experience were compared with the original cage 
studies and, except for one project, were substantially con- 



When there were unresolved differences regarding de- 
finition of goals, objectives, tasks, roles, between project 
directors and staff, for example, it was considered an indi- 
cation of intra-organizational "dissonance" or conflict. 
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slstent with the earlier material. This approach provided 
some confirmation of the reliability -of the data obtained 
regarding the pha§ing-in of new projects. 

In the initial design projection, it was anticipated 
that once the first phase of the study was completed, da^a 
would be analyzed to determine whether there were identifi- 
able patterns of project development, identifiable stages 
of development, and whether criteria for successful work at 
each stage might be specified. If so^ Hn instrument would ' 
be developed to classify projects at each stage and to eval- 
uate them accordingly. 

It was also anticipa ted that subsequently, a sub- 
sample of six projects would be selected for more intensive 
study so as to provide a test of the applicability and reli- 
ability of the instrument developed, to further specify cri- 
teria for evaluation of child advocacy projects, and to re- 
fine the instrument generally. Criteria for selection of this 
sub-sample would be derived from the data provided by the first 
phase of the study. Althoilgh it was assumed that the project 

0 

analysis in this second phase wo\ild be more intensive than in 

— — 1— 

■'"The inconsistency in this instance related to the 
. project director^ definition of the source of intra^-organ- 
izatlonal conflict. In the .initial interview for the *71-'72 
study, she had assumed responsibility and blame;' in the in- 
terview for the current study, the burden of blame was placed 
elsewhere. Since the existence of conflict was not an issue 
(it^was identified as a major problem for the project in^ all 
instances) the question of "blcune^^ for its existence did not* 
make for, any substantial difference in the findings. 
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the earlier phase, exactly what was meant by this or what 
it would entail was not clear. As will be noted in sub- 
sequent chapters, analysis of the data collected in the 
first phase of the study did guide the later phase, but 
not precisely into the expected channels. 

The next chapter begins with a description of the 
phas^ng-in of , a sample of ccmmunity-based chilti advocacy 
projects (their life history from inception and development 
^to current activities at tlj#time studied). Analysis ajid 
classification of the data obtained provide the basl,s for 
the following: ' * . ^ 

1) Determination of patterns of ^normal development"; 

2) Identification of stages in the developmental process; 

3) Identification of tasks fbr each of these phases or 
stages . ^ — ^ 

With the data so .obtained, it becomes possible , then, to turn 

to the remaining portion of the study. 

4) Develbpment of indices of project development in 
order to determine what expectations are reasonable " 
after specified periods of time subsequent to 
funding; 

5) /;^ Identification of evaluation criteria for each 
"developmental stage, such criteria to be derived 

empirically from the descriptive data obtained; 

6) Development of an instrument for differential 
evaluation; 

7) A field test of this instrument to be applied to a 
sub-sample of six projects selected from the twenty- 
three, and an analysis of the findings. 

The following chapters illustrate how this approach 

evolved and how the instrument was developed, 
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CHAPTER IV 

THE NATURAL HISTORY OF COMMUNITY-tBASED CHILD ADVOCACY PROJECTS 

This study's premise is' tha t program evaluation must 
be phase-specific. One asks different questions and employs 
different criteria at different stages in the development of' 
a community-based child advocacy, project. The first major 
task, therefore, is to evolve a way to describe a project's 
natural history. The twenty- three case studies were assem- 
bled with this aim in view. They provided the raw/ material 
lOr an effort at discerning project stages and process. 
This chapter offers a first attempt at ordering the data in 
a fashion which may serve the needs of those interested in 
coaununi ty-^lised child advocacy projects as organizations - 
and those concerned with their assessment. Among the ques- 
tions addressed are: ^ 

- Why a^e child advocacy projects launched? Where do 
the ideas originate? * 

- How are child advocacy projects designed? ^ 

^- What specific activities are involved in\ctually^ 

\ ^ f / ^ 
* setting up such projects in their earliest stages? 

- How do child advocacy projects progfess fr6mr initiating 
Ideos and proposals to^ operating {Organizations? 

4 
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- How do these projects change and differ over time? 
WHAT DO THE PROJECTS LOOK LIKE? 

An Overview 

Before proceeding with the life stories of thes'e 
projects, a brief descriptive ov^prview will provide a pic- \ 
ture of how they- looked at the time of the study. Twenty- 
three projects are in the sample studied. Of these, twenty 
describe themselves as either child or youth advocacy pro- 
jects; three had the label applied to them, albeit inappro- 
priately, by funding agencies. All describe themselves as 
"community-based," with the qualifications about "community" 
mentioned in the last chapter. At the time of the study, 
the typical project .is about one and a half years old and 
is located in a ghetto or lower working class commxinity. 
It is administratively autonomous, although usually under 
the auspices of another public agency or institution, which 
generally acts merely as a conduit for funds. .(The auspice 
may also be referred to as "the sponsoring agency.") It' 
is federally funded with a relatively small budget." Staff 
are paid, few in numbfer, and tend to be indigenous para- 
professionals. It addresses the needs of children and their 
families, rathei' than children alone. It attempts to solve 
problems related to the unresponsiveness of service systems 
working with children (especially schools and/or the Juvenile 
Justice system) or the. failure to Implement rights and en- 
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tltlements. Qenerally,o it employs lay advocacy rather tlMin 
legal and stresees case advocacy^ while trying - or hoping - 
to lnq;>lement class advocacy. 

Additional detail Is needed for orientation and to 
provide context for the description of activities Ih the 
several stages of organizational development. 

Where are the Projects Located? 

The twenty- three 'projects Includec^ln this study are 
situated In fourteen different states. Five are In one state 
California. Two projects are In each of the following: Mary- 
land, New Jersey, North Carolina, Ohio and Tennessee. The 
remainder are located In Arkansas, Colorado, Indiana, Massa- 
chusetts, New York, Pennsylvania, Texas and Washington. They 
are primarily urban; seventeen are located in major \irban 
centers, two in small cities and four are rural. Sixteen 
are specifically "neighborhood" focused, by which is meant 
a single housing project y an area of a few blocks, or a 
single Institution. Of those serving a larger geographic 
area, all are located in cities having populations of less 
than 200,000. 

Who are the Consumers or Clients?^ 

In general, the projects are concemed^ with children 
(or youth) as well as their families. Ten stress advocacy 
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all children in their conununity; three for all under 
the age of five; three, specifically for poor, minority 
youth (although irx reality this is true for all projects 
located in ghe^'tto communities even when they state "air 
children, '^^ by the ;^Very nature of their community); four, 
for delinquent and predelinquent 'yo^th; and two, for 
children situated within a single* institutional system 
(hospital, institution fo^the retarded). 

The size of the target' population (the consumers, 
clients ol* potential beneficiaries .of the program) . ranges 
from P5 to P3>000. The actual number varies, depending 
upon whether it is based on the ^ total ^umber of children in 
the community or only a limited segment; whether jLt is re- 
lated 'to potential consumers of direct service and case 
advocacy or potential beneficiaries of clas^ advocacy. For 
example, six projects with spdtlfic limitations on , their 
target population (e.g., a single institution, children 0-5, 
two classes in a school) -service between 100-500 children; 
eight projects which .serve an unspecified population includ- 
ing a wider age range, have 1000-^^0 in their target popu- 
lation; those projects providing class advocacy serve th^ 
largest tiumber of children, generally several thousand. Al- 
though the age range of children served is 0-l8, fifteen" 
projects concentrate on school age children. 



. Who Sponsors and Who- Funds These Projects? 

Sponsorship by public agencies - community riental 
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health centers, universities, boards of education, hospitals, 
commxinity action programs - is characteristic of almost two- 
thirds of these projects. Eight are under voluntary auspices - 
local branches of nat;^onal organist ions, voluntary hospitals, 
private universities i one is funded directly. More than half 
(12) are administefecl as autonomouB organizations. Three are 

Y \ 

administered under the, close sunervi^ion of the^^onsoring 
organization, while five are merely new components of ongoing 
and existing projects. ^ 

Public funding, in partic\ilar, federal funding, pre- 
dominates; and even those projects supported by voluntary 
funds ^re currently frfeeking exj^sive public funding; Seven- 
teen projects are funded byy^he rederal government, two by 
state governments, and two by^Iuntary funds. Two have 
still not obtained formal funding. - 

Annual budgets range from a low of $27,000 to^ a high 
of $250,000 but mo6t range between and $200,^0 a 

year. On first observation, neither this, nor the earlier 
study suggests any direct correlation between the size of 
the budget and any other variable. The two/ projects with 
the lowest and highest budgets respectively are both des- 
^ cribed by their directors as never having been implemented. 
Those projects with budgets of under $100,000 i;end to.^ve 
very small paid staff (1-3), or rely heAyily on volunteers. 

For the most part, fiscal control Is exercised by the 



auspice or sponsoring agency. Altl^ugn some directors 



are 



not permitted to*authorize any expepralltiire without approval 
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from their auspice, most have a wide range of discretion- 
ary authority in fiscal matt'ers. Severfil developeql their 
own budgets and are . considered accoiintable for remaining 
within them. Four project directors have authority to sign 
checks. In one, the director- assigned fiscal control to ah 
elected community boardj however, after less. than one year, 
he changed this policy iand control reverted to him. 



Who/Determlnes Policy? 

For the most part, the projects follow traditional, 
hieraroliicaHpatterns in their structures. They are organ- 
iz.ed in a two or .three tier hierarchy, with an administrative 
director at the top and an assistant director under him, 
responsible for the supervision of line staff. Where there 
ar,e specialist staff, such as resealrchers, lawyers, social - 
workers, psychologifets, they report directly to the director. 
Most of the authority fox decision making is vested in the 
director of th^ project with some degree,, of involvement of 
staff, and to a lesser extent board. .Only three of^the pro- 
jects, have policy-making boards and these are all appointed, 
not elected. , M^st have ^d-hoc advisory boards, usually com- 
pos^d of professionals and inf luentials; these are relatively 
inactive and meet irregularly on an as-needed basis. Boards 
appear to be a major problem for all of these projects and 
as-^uch will bQ disctissed in greater detail later. 
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Who Are The Child Advbcates? 

Although administrators and supervisors tend to be 
professionals, advocate staff are ovei^helmingly para- 
professional. Two- thirds of the projects are staffed almost 
completely by paraprofession^ls who for the most part are in- 
digenous, young, with limited formal education but usually 
high school g^-aduatesj^^ and relatively inexperienced. Even 
when older, they usually have had very little formal work 
experience. Only>j two p^Jec^s are predominantly professional 
while three ar? about evenly divided between professional and 
paraj)rofessiorial . Five 6f the projects have largely white 
staff; ten are primarily black, one chicano, and the remain- 
der raciallS^ and ethnically mixed. The size of paid staff 
ranges from a, minimum of one to' a maximum of twenty-one . 
All projects except one have paid .staff . Six have fewer than 
four employees; eleven projects have between five and ten 
(including secretarial hekp); four have between fifteen and 
twenty employees and dne project has twenty-one. This last 
project is^ described by its director as "deliberately staff 

heavy," because it is preparing .for the establishment of two 

r 

satellite projects^ J'our projects utilize only volunteers 
as advocates although three of these have paid administrative 
staff; 'two others u^e volunteers in ancillary roles but for 
the most part, staff is paid. 

Initially/^ four of the projects anticipated employing 
both part-time and! full-time staff. By the end of the first 
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year, part-time staffing was eliminated by all of these 
projects. Because of the need for jsjibstantial investment 
in supervision and training, such sltjaff were defined as an. 
expensive and inefficient use of supervisory manpower. 
(Vfilere professionals such as lawyers and social workers were 
employed on a part-time basis, this did not hold true.) For 
many part-time employees, salaries are so low that obtaining 
full-time employment, ^.f possible, is essential. 

Staff turnover has ranged ftom almost a complete 
change in staff, in one. project^ > to no turnover at all in 
another. In four projects, more than half of the staff 
changed during the first year. In twelve, turnover was li- 
mited to less than two people. In two prbjects, where staff 
were sharply reduced at the end of c^e year, it came as a 
result of the elimination of part-time staff. Seven direc-^ 

tors also changed within the first year of operation. Four 

> 

of these were the same as those in which staff turnover was 
high generally; in another, ^'the assistant director who had 
bee^ involved in the initial planning of the project, sub- 
sequently was named director, ensuring some continuity of. 
leadership; in one other, a one year tenure for the directbr 
had been anticipated from the inception of the project. 

As of the Time of jthe Study, What Do the Projects Do and ^ 
How Do They Do TtJ ^ 

» » 
Twenty projects state that ''systems change'^ or 

"institutional change'^ is a major objective. Those located 
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in heavily serviced urban communities, stress as objectives 
a linking of people with appropriate services, ensuring a 
greater responsiveness of services to people's needs (e.g., 
obtaining evening and Saturday clinic hours, evening Parent 
Teacher Association meetings) jand ensuring that people ob- 
tain their legal rights and thjose services they , are entitled 

1 

to. Projects located in underserviced communities and iniral 

t 

areas generally emphasize the need to generate new services 
to fill existing gaps. In some of the more deprived commiini-^ 
ties chljld advocacy becomes an umbrella concept and is used 
to highlight gross inadequacies harmful to children such as 
poverty, youth and adult unemployment, poor housing, absence 
of public transportation. These needs are so pervasive 
that they preclude a focus on^more specialized needs of 
children. 

Of the group of twenty self -defined advocacy projects, 
all provide access services (inf ormat i-on, referral, f ^low- 
up, brokerage); sixteen provide case advocacy specifically; 
four have implemented class advocacy. Although most of the 
others continued to anticipate such action, only one project 
thus far sees a conflict between case aad class advocacy; 
hov^ver, in two, the functions are kept separate. 

Thirteen projects provide some form of direct services 
(counseling, tutoring, recreation), some out of deliberate 
choice - to obtain credibility in the^ commxinity - some be- 
cause inadequacies In existing services impel advocate prac-\ 



er|c ' - ■ csess 



81 



titioners toward such provision; some because of confusion 
about the boundaries of advocate practitioner roles - ad- 
ministrators/ supervisors, staff and saraetimes clients are 
often uncleaf as to parameters, 

' The overwhelming majority of the projects emphasize 
external advocacy and are concerned with implementing 
change in a system or systems other' than their own (l8). 
Two stress the need for interhal advocacy and monitoring of 
the system in which they are based; one of these has never 
been able to implement this. Three have no pret^ensions to 
advocacy at all. 

Lay advocacy is characteristic of almost all the pro- 
jects. Only three have a legal component, involving lawyers 
as part of the staff. A small number of the others use 
legal consultants or refer clients to legal service programs 
for individual needs. 

The entry' point for advocacy tends to be the indi- 
vidualr case. In those projects where the entry point is a 
survey or a study of community needs or problenis, advocacy is 
still initially implemented on an individual case basis 
ing the course of staff inteirviewing families. In a few pro- 
Jects a local service system such as the school system, is 
the entry point for advocacy. Thus, case advocacy predomin- 
ates and cldss advocacy, where it exists, seems to evolve 
from identification of a group of individual cases with simi- 
lar problems, or in a few instances, from monitoring , a ser- 
vice system. 
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The projects are about evenly divided between those 
^ in which advc^cacy is a specialized role and those in fhich 
advocacy is a general practitioner's role. However, only 
in the PCC. - Advocacy Programs and one internal advocacy 
project is a distinction made between "advocacy staff" and 
"other staff." In general, where projects provide services 
other than advocacy, the practitioners are generalists. 
Where the project is clearly concentrating on advocacy ac- 
tivities almost to the exclusion of anything else (and 
there are very few of these) the practitioners are special- 
ists. 

How Old Are These Projects? 

The relatively brief lives of these projects pro- 
vide a unique opportunity for reviewing the process of 
creation and development. At the time they were studied, 
four were between two and two and a half years old (subse- 
quent to funding); sixteen, about one and one half; and 
three between eight months and one year. All began at a 
time when there was still no conceptual clarity^ regarding 
child advocacy and when role and function were still unclear. 

THE LIFE HISTORIES OF COMMUNITY CHILD ADVOCACY PROJECTS 
An Overview 

In studying the life history of child advocacy projects 
the first discovery and perhaps the most important, was the 
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complexity the process and the enormous number of dis- 



crete activities Involved. After studying only a few. It 

was already appaf^^nt that there were many things done be- 

\ 

tween the time Idea"^ for the projects first germinated and 
when they finally becalne operational. By the time the pro- 
cess was completed for all twenty- three , certain activities 
could be Identified as characteristic of all or most o^ the 
projects^ while others were Idiosyncratic or present only In 
a few. Regardless of the number of.actlvltles completed, the 
order In which they occurred and the time when they took 
place varied substantially during the earl^^ years of the pro- 
jects ' lives. 

The following list of activities derived from analy- 
sis of the case studies. Is presented to Indicate the range 
and extenslveness of what was done during this period. It 
also offers the '^raw material*' for a first approximation In 
the -tronceptuallzatlon of stages* In the natural history of a 
community-based project. The presence of an Item does not Im- 
ply that all projects experienced the activity or even that 
most projects did. Nor dld^^^h^e activities necessarily oc- 
cur In the same order In all projects In which they were 
found. 

ir Someone (or some organization) has an Idea about 
establishing a child advocacy project and decj.des 
to do something about It. 
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- Someone (or some organization) is stimulated 
by the availability of money for setting up 
new projects, begins to think about what child 
advocacy is and whether it can be a usefxil 
approach in designing a new project. 

- A problem or a need- related to children is iden- 
tified in the community. 

- One -^or more objectives are^identified, 

- The meaning and implications of child advocacy 
are explored. 

A conceptual framework for solving the problem is 
developed. 

A target commxinity is identified. 

A target popxilation is identified. 

One or mo^ targets for change are identified. 

Strategies for achieving objectives are identi- 
fied or designed. 

An organizational structure is designed* 

A leader, leadership group or developer is identi- 
fied. 

An auspice is obtained. - - , 
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- Potential consumers are involved. 

- Relevant Experts are involved. 

* It 

- Other organizations are involved. 

V 

- An expert is hired to prepare a proposal* 

- A new program component is designed that is consonant 

'\ 

with the existing project. 

•A 

- A leader prepares a proposal. 

- Formal contacts are made with funding eotirces. 

- A formal proposal is submitted to a funding agency. 

- A memorandum is prepared and submitted to higher 
administration^ 

- Funding is sought. 

- Funding is obtained. ^ 

r A decision is made to establish a proj^t without 
formal funding. 

- Administrative support is obtained for a new program 
component. 

- An office is obtained. 

- Equipment is purchased. 
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Administrative staff Is recruited and hired.' 
Supervisory staff Is recruited and hired. 
Line staff Is recruited and hired. 
Specialist staff Is recruited and hired. 
Consultants are recruited and hired. 
Volunteers are recruited and hired. 
Staff Is trained. 

An advisory board Is appointed eind convened. 
A policy-making board Is appointed and convened. 
Board members are elected and the board Is convened. 
A community Is organized « 

Consumers participate In developing the progreun. 

Experts participate In developing the program* 

Other organizations participate In developing the 
prograjn« 

First action targets are specified. 
First action strategies are specified. 
Clientele Is contacted. 

C C 0,3 4 
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- Referral sources are contacted. 

- Target(s) are contacted. 

- Direct services are first provided. 

- Access services are first provided. 

- A survey or other form of information gathering is 
begun. 

- Case advocacy is first' provided. 

- Class advocacy is first provided. 



- Reports are written and submitted, 



- The board is reorganized. 

- The administrative stT*^^ure is reorganized, 

- The staffing pattem is reorganized. 

- Goals are specified. 

- Goals are changed. 

Targets are changed. •* 

- Strategies are changed. 

- The prograjn is reorganized. 
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- Coalitions are formed with other groups or organi- 
zations. 
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- C&se advocacy becomes a^major program aomponent* 

- Class advocacy becomes a major program component* 

- The project Is duplicated elsewhere. 

Any detailed description of these activities. In- 
cluding gome mention of how and when they occur. Is made 
cumbersome by the very extenslvenej^s of the list. Yet, 
any attempt at conceptualizing the process requires that 
they be described first before being ordered anc) axialyzed. 
Since In viewing the historical developtaent of these pro- 
jects. It becomes readily apparent that many activities ^ , 
tend to'^ cluster within certain periods of time, some prim- 
itive categories suggest themselves and serve to focus at- 
tention on critical factors. Thus, for this purpose, this 
description of the life cycle of child advocacy projects 
""may bfe divided Into three parts: beginnings (Why do child 
advocacy projects begin? Where do the Ideas originate? 
How are they designed?); getting established (What Is In- 
volved In 'actiially setting up a child advocacy project?); 
operations (How do these projects progress from Initiating 
Ideas and proposals to operating orgailzatlons?) 

The first time period, "beginnings" culminates when 

1 

projects 'Obtain funding or when, for some other reason, a 
decision Is made td establish a project. Th^ second, 
"getting established" ends when the proJec1| begins to pro- 
vide case or class advocacy. Finally, projects are n^ssumed 

• ' ■ . . COCAS' 



89 



to be ""fully operational" when case or class advocacy 16 
not only prbvided regularly but represents a major por- 
tion of the pro^Ject activities.. 



BEGINNINGS 

Where Do The Ideas- Originate? 

Sarason points out in his book. The Creation of 
New Settings , that "In the past decade or so, more new 
settings (e.g., organizations, institutions, programs, 
projects)... have been created than in the entire previous 
history of the human* race."*^ . He comments that one charac- 
teristic. common to almost all initiators or developers of 
new settings is the absence of any historiqal perspective, 
either with regard to the origin of the pl*oJect or the 
re-t^tionship between what they are currently planning and 
other earlier but relevant experiences. These child ad- 
yocacy projects are no exception. For most, the process of 
^creating a new project is analogous to reinventing the 

o 
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whq^el; almost without exception, the directors view the 
process as unique and idiosyncratic. In only six cases had 
directors heard of the term "cKild advocacy" before begin- 
ning to plan their projects and in only four of these was 
there ariy familiarity with the Joint Commission report and 
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Its recommendations and/or the recommendations of the 1970 
White House Conference on Children awtt Youth. An addi- 
tional six were familiar with the concept of "client 

' ^ . ' i 

advocacy," however, only four of these had considered 

applying the concept to the problems of children and youth. 
In general, concem about quantitative and qualitative In- - 
adequacies In services for children and youth, fragmenta- 
tion of services, the unresponsiveness of existing services 
and Institutions, and the failure ta Implement existing 
rights and entitlements, led Initiators to search out and 
expei^lment with new forms of programming and to be attracted 
" V .Jby the emerging concept of child advocacy once they learned 
of It. Considering' the similar concerns expressed In the 
early sixties regarding the organization arid delivery of 
social services generally. It Is j^ndeed surprising that 
only about one half of the project directors were familiar 
with the relevant expej'lences of community action programs. 
For the most pfiirt, developers of these projects described 
the problems In^ their communities as "recently Identified" 
and saw the projects they developed as being newborn like 
"Venus on the Half -Shell." 

How Did These Projects Begin? 

In reviewing the data related to how child advo- 
cacy projects begin, the first Interesting finding la(|that 
spontaneous Initiatives from community residents or o^gan-* 
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Ized connmunity groups appear to have played no role in ^ . 
stimulating or developing an advocacy project. Since the 
literature makes frequent mention of the importance of ' 
community pressures in generating new organizations, its 
absence as an initiating factor for these projects is note- 
worthy. Whether, this is an indicatj^on of community disin- 
terest, unfamiliarity with a new concept / or the weakness 
of community pressure as an initiating force, cannot l^e 
discerned from the existing data. However, what can be 
noted ^is that once projects are conceived by others, docu- 
mentation of community needs is readily accomplished, and 
many projects obtain widespread community support. 

In contrast to the absence of community pressures 
as an initiating force, four other factors emerge as stim- 
ulating the development of child advocacy projects: One 
group of projects began as a result of the initiatives of 
an individual or small group; a second group began in res- 
^onsiB to funding agencies' dire^ct or indirect initiatives j 
a third group^ began as a result of sponsoring organizations' 
search for new funds to support existing programs, and 
finally, the fourth groUp began because one federal agency 
announced that a grant would be provided to certain specified 
projects for the establishment of n6w advocacy components, 
as an extension of their existing programs. 

Although each project began in one of these four ways 
in only one pattern of initiation was the availability of 
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new funfls not the single most Important factor. Regard- 
less of the specific role played by funding agencies, the 
availability of new fxmds l^or the creation of child ad- 
vocacy projects appears to have been a primary stimulus 
either by Influencing the development pf k proposal or 
by directly initiating the process. However, as seei^^e- 
low, the specific way In which a project l>eglns does 
appear to have some relation ^o the types of activities 
performed and the leYigth of time covered by this beginning 
phase. - ^ ' 



Number of 
Frojepts 



How Projects Began 



8 
7 



Individual Initiative 
Tunding Agenpy Initiative 
Sponsoring Agency Initiativ^ 
Funding Agency Attthorizatiop 



Months covered from 
beginning activity" 
to propos al submission 



(or estapiishmeot of 
project f " 



2-4.9 



1 

3 



5-7.9 



2 

3 
3 



8-10.9 



11+ 



«« 



♦Length o€ time covered for one project is not known. 

**Thi8 pj-oject began as a result of both individual initiatives 
and funding agency initiatives. 
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Individual Initiatives ; In eight projects an i^di^ 
vldual or group of individuals had an idea; discussed.lt; 
designed a program; possibly jprepared an Informal proposal; 
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and then actively sought funding foi^ it. In one project, 
child advo^cy was viewed as a means for protecting child- 
ren's rights in closed instit\^tions . In two, ^ initially 
there was Just some general Concern' about the low prior- 
ity for children's services ajid the c^n«ept ^hat child 
advocacy might provide a new framework in which to pressure 
a community or institution to re-order its priorities. In 
five, there was concern about a particular problem {delin- 
quency, inadequate protection of children's and/or st^deij^ts'^ 
rights, unresponsiveness of the schools to students' needs, 
or the failure to vieli the child Within his total environ- ^ 
ment and the consequent ^inappropriatehess of interventlve 
strategies) . ' 

For the most part, this group begun by individual 
initiatives, includes the oldest of the pr^Djects/ the 
developers who were most familiar with the concc/pt of child 
advocacy, and with the exception of two, those projects 
with' the most extensive activities prior to obtaining fund- 
ing. With' regard to the'two exceptions, neither are de- ^ 
fined by their directors as having been implemented at the 
time of the study. 

Although the per4.od of time devoted to plajaning a 
project ranged from two months to two Veas, four of these - 
were planned over a period of about one year. One that was 
developed within a very brief period of time is described by 
its director as never having been implemented} one other was 
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explicitly modeled aHer andther, more extensively plcurmed 
project; a third that was begun in less than a year is 
unique in that it was developed by people who have extensive 
experience with related projects ind with the relevant com- 
munity; were intensely committed to the conceptual frame- 
^ work employed and to the objectives ^and strategies incorpo- 
rated in the project; akd already had an existing consti- 
tuency in the community and a great deal of persqnal cre- 
dibility. 

Although these eight projects completed all the 
Standard activities such as identifying a problem, ob- 
jectives, target community and target poptQation, designing 

i • . \ 

a structure, selecting an auspice, most are unusual in com- 
parison with the remaining fifteen, in that they were de- 
signed within a specific conceptual framework. In addition, 
most spent e^ictensive time in contacting both experts and 
^lafe^^nsumers who might be interested in such a project as well 
as relevant orgpilzations and agencies in the community. 
These contacts were accomplished through a variety of formal 
knd informal means^ sjich as meetings, workshdps, personal 
contacts. Finally, as a group, they are \inique in that no 
outside professional was responsible for the preparation of 
.any of the proposals subsequently stAmitted to funding ^ 
agencies. Where formal proposals requesting fujiding by out- 
side sources were developed^by this grov?), all were prepared 
within a^ very brief period of time. - one or two weeks. 

C ^^ 0 2 \ • . 
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^ Funding Agency Initiatives ; A second group of seven 

projects Ssegan In response to funding 'agencies ' active Ini- 
tiation of proposal development,- either by publicizing "^^^^^ 
availability of funds for child advocacy projects or by 
personal contact, suggesting that proposals for such projects 
would be of interest to an agency. For two other projects 
.this influence was an important factor in determining the 
particular "look" that the project finally developed. 

One orgguiization notified over 100 institutions^, 
agencies and individuals that it was interested In funding 
community-based child advocacy projects; individual officials 
and administrators informally notified niai>y others. In two 
other agencies, administrators telephoned practitioners as 
p well as researchers informing them of agency interest in 

such a project and the availability of funding. In all 
of these, the projects were deliberately designed and tailored 
to meet Implicit and explicit guidelines of funding agencies. 
• A vague, conceptual freunework vretb provided by the agency to 
stimulate Indlviduals^to explore possibilities for program- 
ralng. Like the first group of planners^ they then proceeded 
to select people to help design a program: to identify -objec- 
tives and strategies; tp begin to develop constituencies; 
ir and to prepare a formal, proposal . 

In general, this group that began in -response to ' 
funding agencies* initiatives, accomplished the widest and 

most disparate range of activities. For example, one project 
p 
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went so far to obtain 'conununlty Involvement and support 
while developing a proposal for submission to a federal 
agency, that the leddershlp group assured the community a 
child advocacy project would be established within one 
. year, with or without federal funds. To reihforce this 
promise, before receiving any indication of favorable 
response on their proposed project, they actively engaged 
in commtinity organizing, held elections for board member- 
8,hlp and even convened a board. In another case, equally 
strong efforts of another type were employed to generate 
widespread community support. The leadership group met 
with the main community organization, discussed community 
^ needs apd priorities and prepared a proposal which was 

then submitted first to this group for approval. - When the 
group rejected It, several weeks were spent In further dis- 
cussion culminating In the preparation of a completely new 
-proposal i^hlch^^ was finally endorsed by the group and then 
submitted for funding. 

On the other hand, several projects made no effort 
at ^11 to ensure community and/or consumer support. However, 
^ most did obtain outside experts to provide advice apd.ln y 
some cases technical assistance, especially with regard to 
preparing proposal's. 

For these seven, as for" the projects described ear- 
. lier, the period of time covering these activities ranged 
^ f rom .two nionths to two years, however, most were planned In 
about five or six months., 
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. sponsoring Agency Initiatives : A thircl appkpach to 
beginning a child advocacy project was one In whlch\JdTe 
spon3or4.ng agency or auspice developed a proposal In drder 
to expand an existing program or some variation of it, and 
then sought funding. In some, the proposal was written and 
rewritten several tinies for ^bmlsslon to different funding 
sources and private foundatloh^. The four projects funded 
as a consequence of this route. Include those where the 
directors were totally unfamiliar with the term child advo- 
cacy and openly expressed Ignorance as to the reason for 
the label having- been appended. In some Instajices, the 
label was applied by the sponsors specifically t^ obtain 
funding. Although Individual practitioners in the project 
might be Involved in occasional advocacy activities, as a 
whole the project was not. For the most part these projects 
are characterized- by an extensive gap between the poncep- » 
tual framework of the proposal and the way the program looks 
in operation. All proposals in this group were written by 
professional proposal writers who had np real relationship 
to the project; none of the directors participated- in the 
planning process; all "inherited" a proposal which they then 
had to implement. For some, conflict between the sponsoring 
agency and the project director beciime^.a major source of 
difficulty once the program began operating. 

Although in this group it is harder to delineate 
exactly how and when the project was plajined, the formal in- 
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gredlents are all^preeent on paper: Problem definition; Iden- 
tlflcatlon of objectives, strategies, target conmiiinlty and 
target population. However, In none of these Is there any 
Indication of any real community Involvement, either pro- 
fessional or lay. In the ^early activities. 

Funding Agency/IVuthorlzatlon : Finally, three proj^ts 
began because the Office of Child Development wanted to pro- 
mote advocacy activities In Parent ^Chlld Centers. These 
three, along with ^S^^ other Parent Child Cent^fll^, were se- 
lected to b^ the recipients of a specific grant to enable 
them to plfiin and develop new advocacy progrart components . 
Guidelines were laid down and Included a statement of general 
objectives^ An evaluation research consultant was Involved 
from the Inception to help directors to find measurable 
objectives emd to obtain baseline data. This group Is unique 



In that funding preceded planning. Developers wef^e com- 

J 

pletely unfamiliar with the concep| of child advocficy until 
the funding agency made the grant. Perhaps because of fund- 
ing agency requirements as well as^ the fact that these were 
' new components of existing projects rather than completely 
new projects, none took longer than five months to plan and 
prepare a formal proposal and most took less time. , 

One of the first activities of these projects was 
overcoming the resistance of existing staff and board to be- 
coming actively Involved In planning a program that was not 
of their choosing and did not reflect their p/^lorltles. Pos- 
sibly related' to this sense of ^^Involvement In the planning 
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process and an absentee of commitment to the project, as a ^ , ^ 
'group these project* indicated that they had "had the most 
difficulty with formal proposal 'preparation. 

Thus,, activities here involved not only those re- 
lated to developing a new program, but integrating it into 
an already^ existing^^e, when jieither director, staff, nor , 
board initiated it. Among these activities were: discover- 
ing what might be mfeant by child advocacy; ^ designing V pro- 
gram cc&nponent consonant with the existiijig project; decid- 
ing whether to recruit new staff or employ staff from the ^ 
existing project; avoiding conflict between the new component ^ 
and the existing project. 

In contrast to these* problems related to beginning^-^^ — — 
a new component of afi existing prografti and planning under 
pressure from the funding agency, other problems arise when 
the planning begins without any .assurance of funding. Ob- 
vious^, starting a project undej such circumstances Implies 
a willingness to risk or gamble time and effort - and 
thus necessitates a substajitial commitment by th6 initiators 
and developers to the project and Its goals. 

Fdr analytic puiTposes it seems appropriate to con- 
ceptualize the end of this first phase with pr^osal prepar- 
ation' and submission. For the fact is that in almost all 
cases (18) these beginning activities culminated in the prepar- 
ation of a formal proposal; twp others prepared a written 
memorandum, while in three 1^he process never concluded with 
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the preparation of any kind of document although a decision ^ 
vfas made to establish a project. Several of the proposals 
were prepared, submitted, rejected, reviewed and re-submltted, 
For ^me projects, tiie process may end here; Some projects 
In this study changed their design and mission as a result 
of this process. Regardless, for the group that proceeded 
to the next series of activities, this, Is the end of the 
begl^!lng phase. 

N . 

GETTINa A CHILD ADVOCACY PROJECT ESTABLISHED 

Once planning for- a new project Is completed (ajid th^s 
Is generally considered to be onceS,^ is funded)', the lss\le 
Is^how to move from the theoretical proposal to an operating 
prograun? How does one Implement a plan? Even In the two 
pro;}ects where special funds have not been secured, a time 
arrived when the Initiators decided to go eihead and "try 
the theory ^ut" and actually develop an operating project. 

There appear to be three approaches to this process 
of establishing a new progreim. They ceui be described as 
cr*8h programming , developmental programming and structured 
programming . • . 

Crash programming Is the approach followed by eOmost 
half the projects studied (li). This process Involves the 
ImpllcltJ assiiraptlon that the proposal developed addressed all 
major problems and practice Issues and could be readily and 
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rapidly Implemented. Except in one case, within J;hree months 

^" ■ ' • 

after the projects vfere funded, directors, assistant direc- 

tors., staff and secretarial help were hired; advJbsorjr boards > 
or policy-malcing boards were appointed or elected; staff 
were trained; xither agencies wer6 contacted; and doors were 
ope|ied for service. ^ . 

(Tn several of these staff were fecruited from exists • 
ing. host i^rojects or from a component program of the, sponsor- 
, ing organization^ in particular one -that had just lost its 
funding.' In oh© project, where the board was^ responsible for 
recruitment. and hiring, several board members resigned to 
take s^affCiJositions.' " ' ' 

\- .^taf ft raining tended to be- minimal fgtr this group.. 
Between one ahd two weeks were spent in orJLentl-ng line staff 
to each other, to the project, and instructing them Jbn their 
roles and functions. In "those projects where staff were 
professional, trained or experienced, it wa| assumed that no^ 
training was necessary; where staff were Inexperienced, this 
failure to provide more extensS^ve training wa^^ often defined, 
as a problem by the director of the project subsequently. ' In 

mostC staff tended to describe their roles in conventional v 

J 

terms of direct service provision. 

Specifically, this group includes the projects that 
were required to move rapidly by a funding agency provj^ing ^ 
a one year grant for what was expected to be a one year pro- 
Ject. The agency insisted that the projects be operational ■ 
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within two to three months after approval of the proposal 
and placed further pressure on the proJect\by involving 
outside evaluators who needed ta obtain immediate baseline 
data. Related to this, the projects were required to have 
begun a survey of community needs and priorities' and to 
have interviewed a certain number of families within a 
specified period of time. The directors involved have sub- 
sequently indicated in interviews that this pressure for 
instant service delivery led to a variety of iater problems. 
For example, there was inadeqxiate time to recruit competent 
staff and inadequate time to train staff; thus, interviews 
in the community were done inappropriately and information 
was often discovered latgr to be in&ccixratej cases requiring 
advocacy activities we»e-iiot serviced; where cas6 advocacy 
occulrred, no subsequent follow-up by practltlofners completed 
te process* " o 

A second cluster of projects employing this approath 
Is one In which the sponsoring agency was responsible for 
planning. the project. (One of these projects was "lost" for 

one year after funding and nothing was done by the sponsaririg 

* 

organization to establish it dxxring that time I ) For these 
administrative (and sometimes all) staff were hired almost 
Immediately by the directors of the sponsoring agSncy. Pro- 
posals for these projects were uniformly prepared and written 
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^<A- City received notification of an award but nothing 
was done about It for one year. 
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by professional proposal writers having notl^t^g^to do with 
\he project; subsequently, they w? re given to newly hired 
directors, who were told to implement them. Often with 
barely enough time or background to integrate it or raise 
questions about it, the directors were supposed to "get the 
project going," . , 

Although part of normal project development is 
^c oping with problems, most of this- group of eleven appeared 
:o be dominated by problems, and these may have derived from 
the "crash programm^pg," Except for one project, fill o^ 
these were in difficulty by the end of their first year of 
operation and/most, if not all, readily acknowledged it. As 
a group, these projects had 'the highest rate of staff turn- 
overs (the highest is a project that does not really belong 
in tni^ study at all; it is not an advocacy project but was 
inappropriately labeled as such by the funding agency.) 

All tjiose that had boards - ejected or appointed, 
advisory or policy-making - have had problems with them, in 
some instances leading to dissolution and subsequent restruc- 
turing of the board. For example, on^ elected board that 
was described as "pplicy-ma|^ing,"* included ten lay i;epresen- 
tatives from the community and six prpfessionals who wprked 
there. Not only did the professionals dominate the board but 
they were so identif ied> with their own vested in^terests that 
th^ 'could never agree on any issue And were in constant con- 
flict with admii^istration and staff. By the end of the first 
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year, the board was dls%olved by the principal Investigator 
of the project and only after four months had passed was 
aiiother ^SjP^erapt made at electing a board. None* of the ori- 
ginal members were ^-elected. A second pi^oject had In- 
cluded as one of l€llh^ objectives th^ establishment of a policy 
making you*th board. While preparing for elections In tfte 
local high schools the project administrator decided that 
the youl^hs were too radical and concluded that It would be 
an error to hold elections. Thus, the board has^ever been 
established during the eighteen months of l*ts existence. In 
a third, the board was elected from the community with the , 
understanding that It vould make policy. When the director 
of the sponsoring organization Imposed extensive restric- 
tions on what It c.ould do, confl|^t arose. By the end of 
the first year, hone of the youth members and few of the 
adult members were attending meetings; In effect, the board 
was dead. Where advisory boards were appointed, for the 
most part, ^hey were . conqposed of Influential lay people In 
the community or professionals and are described as "ad hoc 
bbards." Generfi^ly, these boards met one or two times dur- 
ing ttle first year or two Of the project's life and appeared 
to be relatively unlnvolved In the regidar a^ctlvltles of the 
project. 

Several projects have undergone administrative reor- 
ganization after about one year or even less, and others 
have reorganized staffing patterns or programming activities. 
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In some cases , these ^ctions were described as a consequence . 
of existing difficulties in the project. E^or example, an 
apptiinted policy-making board could not agree on what the 
objectives of the program sRbuld be, let alone prio-rities 
for developing it and thus was dissolved after about six 
months and a new board was appointed. At the time of the 
study, this board was still in the process of considering 
what the obJecl?tives of the project should be. In., other 
cases, changes were instituted in response to the decision 
to further specify goaJLs and strategies and to improve pro- 
gram functioning. One project eliminated its lowest level' 
staff, part-time assistants from the commxinity, because they 
were too inexperienced to work independently, could not be 
effectively supervised by line staff who were equally inex- 
perienced, and required too much time from supervisory staYf. 

At th'e close of the first year, most of these pro- 
Jects still did not describe themselves as "fully operational. 
Most specified obstacles and problems aroxind implementing 
their progri^ and, interestingly, none of these problems 
had been anticipated by the directors. What problems did 
arise were defined solely as a consequence of external fac- 
tors: funding agency pressures; sponsoring agency interfer- 
ence; conflicting guidelines; lack of money. Inadeqiiate 
planning, poor leadership or hastily implemented programs 
were rarely seen as the source of difficulty. 

The se€^d largest group of projects (7) employed a 
developmental Wp r o/ch to programming. As a whole, these 
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projects were trying to develop by a process of "learning 
through doing." Some learned well, others not. For these,- 
establishing aji drgsjalzatlonal structure was defined as the 
fltst actlAilty. Once this was accomplished, most directors 
assumed that programming activities would evolve naturally. 

Thus, the first activities for a new, project, once 
funded, were to recruit and hire a director, an assistant 
director, and to obtain a physical facility (an office). 
Generally, this took about two to six months « Most projects 
had difficulty obtaining office space. Highly visible and 
readily accessible space, that was reasonably comfortable and 
available for rent, was difficult to obtain. Several projects 
began with temporary space, and one began In the director's 
home. Some directors defined this difficulty In obtaining 
office space as an obstacle to project Implementation while 
others treated It as a minor Impediment. Once administrative 
and supervisory staff were hired, advocate staff were re- 
cruited and hired from within the target cDmm\inlty. Gen- 
erally, this proceeis covered a period of two to four months. 
During this time, directors were beginning to meet with ad- 
mlnlstrators and representatives of other agencies and organ- 
izations In the community, to explain the nature of the new 
project and to develop informal, cooperative linkages with 
them. > 

Following this, staff were trained. Training tended 
to be done by administrative and supervisory staff. Except 
In two projects It was relatively informal, covering a wide 
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range cf time from a few days to six weeks. For some, it 
was seen as a one shot process while for ot^her vras ' 
built into an ongoing staff development program. 

One project instituted a "formal six week training 
program for its indigenous paraprofessional staff. Social 
workers, teachers, police and probation officers were in- 
vited to meet with the staff and describe their roles and 
explalh^their agency's programs." Social workers provided 
instruction in interviewing skills; teachers explained the 
workings of the local school system; police and probation 
officers identified some of their concerns regarding com- 
m\inity youth; representatives of other agencies in the com- 
munity came to describe their own programs And indicate what 
relevant resources existed for the new project. This training 
program was repeated at the beginning of the project's second 
year and both old and new staff were expected to participate. 
Furthermore, by that time, the administrator of the project 
had establi^ied a relationship with a local branch of a well 
knovm college and staff were encouraged to take courses lead- 
ing to formal cred6ntials. ^....^.c^^-^^^''^ 

Staff training provided another route for publicizing 
some programs and mobilizing constituencies for them. Repre- 
sentatives of social agencies, civic* groups, community organi- 
zations, were brought to projects to speak to staff and ex- 
plain their agency's function as well as to get clarification 
about the activities of the new projects. Often, meetings 
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were held in the community with parent groups, to^ provide 
open forums for informal discussion of community problems 
and issues and to elicit some indication of community 
^ priorities requiring advocacy-type intervention. 

Specialized professional staff, such as lawyers, 
were much more difficult to recruit and in all projects em- 
ploying such staff, the process lasted for between six to 

/ 

eight months. Except for this category, all of these projects 
had a full ccanpiement of staff by the end of the first six 
months . 

In addition, two had established advisory boards com- 
posed of professionals and community influentials . The re- 
maining four had deliberately decided not to establish a > 
board until the project was firmly established. 

Some form of service provision - access services, covin- 
seling, tutoring - or other activities such as planning or 
data collection,, were begun between the fifttt and eighth month 
after funding. In particular, projects that offer more tra- 
ditional serviceaJbegan providing them earlier than others. 
When provided, advocacy activities began later. Contacting 
the comm\inity - clients, potential clients, agencies, and or- 
ganizations who were potential sources of referral as well as 
other services - continued throughout this period. Toward 
the end of the first year, one of the projects even began to 
actively organize coalitions with other organizations in/ the 
community, a task most postponed until the second year. 
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"Housekeeping tasks" are described as a major bur- 
den in the second half^ of the first year. Report writing - 
.from advocates- to supervisors; supervisors to administrators; 
administrators to funding agencies - is a constant source 
of irritation. This may be furthe^ exacerbated by* the pre- 
sence of outside evaluators who require additional reports 
or paperwork,' In addition, proposals , have to be prepared 
and submitted for refunding. For some projects, especially 
those without an explicit conceptual framework and a sense 
df "mission", much of these tasks are seen as an enormous 
burden. The reports often appear to be discrete; at other 
times they seem overlapping. There is little sense of pro- 
gress and often, problems are so varied and overwhelming 
that the recording pfocess appears to highlight them and 
t Me function of feedback from such reports is lost. 

By the end of the first year, these projects tend 
to be somewhat ambivalent about what has been achieved. , 
Half state that the projects are still not fully operational. 
Almost all find it necessary to redefine their goals, nar- 
rowing them down, making them more precise and limiting the 
number of targets addressed. Similarly, all are concerned 
with the need to re-think strategies previously employed 
and restmicture or redesign the nature of the program gen- 
erftljy^ Four projects in this category have begun to im- 
plement case advocacy and one has initiated class advocacy. 
However, most feel that they are under pressure to provide 
direct service and thus, advocacy activities receive less em- 
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phasls than anticipated. • . 

Confusion about staff roles is pervasive. In one 
program, eilthough the director and assistajit. director have 
a sehse of a^J^evement vis-a-vis the community and other 
agencies, they are constantly grappling with low staff morale. 
Staff have been largely \in<Jer-utilized throughout ihe IXfe ^ 
of the project, and have little sense of involvement, utility, 
value or achievement; thus a diminishing sense of commitment 
to the project. In one other, some of the staff roles have 
been redefined several times. Where role and function is 
clear, within a legal component for example, enthusiasm etnd 
a strong sense of achievement exist. For exan5)le, one project 
that has a lawyer on its staff is among the very few that 
have implemented class advocacy on a regular basis. On the 
other hand, where roles are unclear and frequently restruc- 
tured and redefined, staff have little sense of direction 
and morale is low. In two projects where the major target for 
change is the school, confusion about staff roles remained so 
pervasiv^a that a formal contract was drawn up specifying the 
duties and obligations of both teachers and advocates. In 
^ ^one of these, several months into the project's second year. 
Inhere was still no agreement by the teachers to this contract. - 
Finally, there is the third and smallest group, that 
employs the approach termed structured progrcumoing . As a 
whole, this group took a more deliberate approach to phasing 
in the operations of the project. Most of them have as direc- 
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tors, people who were heavily involved in plainning the pro-^ 
gram as well as operating it, As'^ one project director said, 
"creating an organizational structure is the first task for 
the project, but it is essential that it not be created in a 
vacuum." It had t6 be a structure that would facilitate 
goal achievement ai^ thus, each component part needed to be 
carefully selected -with an eye to fitting together board, 
staff, consultants, so that as. a collective entity It would 
be more effective than as individuals. Although no project 
managed to obtain exactly th^ staff desired, these were mcire 
likely to than others. 

All of these placed a particularly heavy emphasis on 
staff training involving about two to three months. Some 
implemented training programs on an annual basis. One^pro- 
Ject, using volunteers, carefully developed a training pro- 
. greun for them also. All stressed the use of specialist staff 
or^outside consultants (lawyers, child psychologists, social 
workers) for formal training purposes. In one project lawyers 
were employed to instruct paraprofessional staff in the de- 
tails of the state legislative code regarding schooling (e.g., 
under what c ire vims teunces can students be suspended? ^^^r how 
long a period? With vrhat kind of notification to students 
and parents? Uhder what circumstances is corporal punishment 
permitted? With what kind of restrictions?) Other experts 
were used to teach staff about the structure of the school 
system so that they would know where in the administrative 
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hierarchy intervention could be most effective. The over- 
all objective here was to provide staff with necessary train- 
ing to act .as advocates for students. 

Staff tended to be clear about their roles and 
openly expressed a sense of achievement. In noiffe were any 
services provided before a minimum of six months after 
funding and f^or the most part, once begun, they expanded grad- 
ually with a regiQar review of programming, initialing 
changes where necessary. 

Characteristic of this group Is a sense of "mission" 
mentioned by all. staff including principal investigators, 
directors and line workers. Each was clear about the pro- 
ject's objectives and strongly identified with achieving them. 
Although all of these *+iave boards, membership is appointed 
rather than elected, and only three are really active and 
have some input into policy. Two boards/ are composed solely 
of community elite and professionals; however, the executive 
director and staff of these projects ate all indigenous youths, 
thus ensuring identification with the community as well as in- 
volvement of the community^in the project. Another board in- 
cludes both community professionals and lay people. In each 
project, board members are selected for their special 'cbm- 
mitment to the project. 

In somef case advocacy activities were inqplemented 
by the eighth month of the project's life while in othera/ 
not until the end of the first year. In all they are/an in- 
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tegral part;^of the program even when direct services are 
provided also. Class advocacy was Implemented by the end 
Qf the first year In only one^project. However, In both- * 
this one as' wfell as the earlier mentioned project In which 
class advocacy was implemented by this time, a lawyer is 
a regular member of the staff. Case and class advocacy are 
Integrated within the project but segregated by roles with 
different people implementing each. Targets addressed by 
these projects are fewer in number than for others; they 
tend to be the most specialized projects, specifically con- 
centratlng either on the school system or on the Juvenile 
Justice system. Housekeeping tasks are described as less 
onerous for this group. Perhaps because they are viewed as 
documenting the progress and achievements of the project, 
they are employed for feedback purposes. 

\ 

OPERATIONS 

Since this study is concerned with valid child advocacy 
projects, the period of time in which a project becomes opera- 
tional is assumed to begin when case or class advocacy ac- 
tivities are first provided. Projects are defined as "fully 
operational" when advocacy activities characterize the ma- 
jor program component, (more than one half of project activi- 
ties) and a similar portion of staff time. At the onset of 
this study, Vione of these projects^ were more than two and a 

» 
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half years old ( since funding) , and only three were more 
than one and a half years old. Of the twenty-three projects 
studied, only eleven had begun activities associated* with, 
operationalizing projects. Only two have completed this 
process (the two oldest) while one other may be approaching 
completion. Thus, at most, Jihree projects have reached the 
status termed "fully operati,6nal." With such limited 
experience, whatever is said about the activities composing 
this phase is necessarily tentative. Some indication of how 
projects proceeded from their beginning activities to becoming 
operational may be seen in the table below. 

By the middle of the second year, two projects are 
already expressing their doubts about their continued exis- 
tence. Several continue to be concentrated on organizational 
problems: directors changed, staff resigned or were discharged, 
boards were reorganized. In these projects , ^f forts con- 
tinue to be focused on internal problems and directors express 
frustration with their inabilit^y to address progJCjtmming is- 
sues. A few others are having obvious difficulties in their 
relationships with the community. This is revealed in a 
variety of wa^s: services may not be adequately utilized by 
the commiinlty (e.g., few referrals are made); the project 
may have nq^^ns tituency (where there are boards, membership 
is inactive and new members are hard to recruit; few people 
in the community may know of the project); advocate practi- 
tioners may get caught up in providing a great deal of direct 
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' service which may ^ needed but Is not advocacy; other agen- 

cies and potential clletits perceive the project as a* direct 
service agency rather than as an advocacy project* Advocacy - 
- case or class - becomes^ Increasingly difficult to Implement 
subsequent conflict may arise within the staff or between 
^•taff an^ a.jMl„lstratlo„ and/or board. ' L 

^ For eight other projects, this period Is one In which 
t^xe organization Itself functions with minimal difficulty and 
the project turns its efforts outward. Access services con- 
tinue to be provlde4 but with fitn Increasjed awareness of the 
^ need, to remain Informed about community resources and toy 
follow-yp on individual referrals. Case advocacy is implemen- 
ted with growing freflt^ency and referrals to the project in-l 
crease as credibility becomes more widespread. Consumers 
hear, about the project and view it as an effective resource; 
^ other institutions experience Interventive efforts by pro- 
^ Ject staff. Extensive knowledge of the community, especially 
of the relevant target system is defined as crucial in this 
period, by several directors. One project, that was addressing 
a widely dispersed group of targets began to focus its in- 
terventive efforts on one particular target. 

During this period*, many of these projects begin to 
seek out other organizations' and groups to Join wilh them in 
taking positions and actions on common problems. The devel- \^ 
opment of coalitions is identified as essential by those who 
recognize that^ certain problems cannot be addressed by only 
one ' organization in the community. For example, a glue- 
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sniffing problem among youths^ may require action by parent 

J 

groups, the school, local btxsiness organizations, as well 
as the city legislature. Changing laws <. may require actlvlify 
by a variety of organizations around the state. In gen- 
eral, tJjft, projects are much better known by the end of 
the second yfear; one even received nationwide publicity 
about its accomplishments. 

Several became increasingly concerned with developing 
"representative community boards, however, this is as likely 
to be dcine because of fxinding- agency pressures as because 
it is essential for effective implementation of the program. 
With growing recognition of what is realistic and possible 
to achieve and what is not, ^goals are often redefined again 
ajid made more precise. There is beginning concern with eval- 
uation and a desire to verify self-perceptions of effective^ 
ness. 

By the middle of the second year, efforts at repli- 
cation (or as one director terms it "exportation^') .were be- 
gun by three projects. One has been sufficiently success- 
ful that eight individuals in different communities have 
been interested in replicating the original models Those 
sites described as "least successful" are those where there 
was failure tor follow the mo4el staffing pattern - using in- 
digenous community youth as directors and staff and committed 
professionals and influential lay people as board members.' 
The most "successfia" are described by the director as those 
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with widespread commiinlty support and indigenous leadership. 
In another 3 a satellite project was established and closed 
after six months and the project's demise and the communi- 
ty's failure to utilize Its services was ascribed (by the 
director and assistant director) to the fragmented nature 
of the community, the absence of any constituency for the 
program, the difficulty In obtaining competent Indigenous 
staff and the weakness of project leadership, A third pro- 
ject Is only now In the process or replicating Its program ^ 
In several different sites i It remains to be seen whether It 
can acQompllsh this -satisfactorily. One other project was 
asked by a nearby community to help and establish something 
similar. It did a feasibility study of the community and con- 
cluded that the absence of community support and Indigenous 
leadership precluded such a development at that time. The 
dli:ector recommended that efforts at organizing the com- 
munity and Involving community groups In a planning process 
be Implemented before attempting to establish such a project. 
Developing proposals for satellite projects and other re- 
lated projects for new services such as alternative schools, 
halfway houses, youth employment programs, occurs during this 
period also, 

, . For three operational projects anticipating proyi^^rfron 
of class advocacy as well as case advocacy, such Intervention 
is In^lemented by the end of the second. ^ear* Although six- 
teen projects state that they Intend to provide class advo- 
cacy, only four have done so, Wiere' class advocacy Is pro- 
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vided. It Is generally by different components within thy^ 

project; for example, staff may do case advocacy while 

directors do class advocacy (this has other implications 

to be discussed later) . Projects exhibit a new type of 

problem in this period. Funding agencies may pressure for 

rapid expansion or replication of the project. Directors 

of projects receiving, widespread publicity may find them-- 

selves torn between moving into a larger arena or cmcen- 

trating on the immediate concerns of their own project and 

the community it addresses. 

Only three of the projects in the sample had 
« 

reached their third year of operation when studied in the 
field and one of these has continued as a volunteer effort 
and never received fonnal funding. At this pointy the pri- 
mary concern ^r^ these projects is the question of their ' 
survival. One of these three is a federally funded resec^rch 
and demonstration project that has been notified that It will 
not be refunded bpyond its thirty-third month althoxigh it ^ 
has been considered unusually Successful by the coram\mity as 
well as by Independent evaliiators, influential professionals 
and lay people throughout the country. Much of the direc- 
tor's current effort is going* into seeking alternative funds 
either for this project or developing other proposals for new 
funding. Staff are concerned, thinking about looking for 
other employment, frustrated and expressing a sense of impo- 
tence. "If a project is a proven succesi^, why let it die?" 
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they ask. ' . 

A second project, supported wholly by voluntary 
f\ands ajid with strong ties to the business community and 
private philanthropy. Is facing similar problems. Private 
funding on a continuing basis Is difficult to generate; one 
satellite project has managed to become self-supporting after 
two and a half years, raising funds from within Its local 
community. However, others have not reached that point yet. 
The central organization is actively seeking federal funding 
now but has not as yet obtained any. Among other approaches, 
one of its confederate group is considering a reorganization 
and expansion of its board, in order to Include more local 
business elite in an effort at expanding local fund raising. 
Another has decided to employ a "development officer" whose 
special Job it would be to do fund raising outside of the 
local community.' 

These three projects are all implenliinting both case 
and class advocfacy. However, one finds i«L conflict between 
the two and has decided to concentrate on the former. Two 
project directors state that as their advocacy act^itles in- 
crease and become obviously effective their constlJlency ex- 
pands but target institutions begin to view them mdaW as a 
threat. All stress the need to straddle a fine llne^tjetween 
continuing their efforts at affecting change at the same time 
as they minimize direct confrontation techniques and' reject 
strong adversarial positions. Concentration on a limited, num- 
ber of targets, a thorbugh knowledge of the target system 
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addressed, fact finding and documentation of every issue re- 
quiring advocacy, and substantive expertise are identified 
as essehtial for effective negotiation and persuasion. VJith- 
in this context, direct confrontation techniques are employed 
less and defined as less necessary. Class advocacy, derived 
from an analysis of case advocacy activities, with exten- 
sive docvunentation of individual cases ajnd support for posi- 
tions taken, is increasingly implemented. Possible use of 
legal action, in particular, class action suits, are seen 
as an effective back-up for class advocacy. 

Concern with internal organizational structure is 
minimal; conceA with evaluation is high in order to docu- 
ment achievements proving the value of the project. However, 
primary concern is survival - the search for continued existence < 

• SUMMRY 

To s\im up, in this chapter we have looked at three 
projects that are less than one year old; sixteen that are 

4 

between one and one and one half; and four between two and 
two €uid a half years old. All, by the very fact that they 
received funding or made the decision to establish a project, 
have conqpleted their beginning activities. Twelve are still 
in the process of getting established. Employing the cri- 
terion of beginning case or class advocacy in some form as 
demonstrating the onset of dperationalizing a project, eleven 
have begun this process and of these one has almost conqpleted 
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It, Finally, two prpjects are considered to be full^y opera- 
tional. 

In general, it appears to take six to twelve months . 
to plan a project. Activities that seem "tnost characteristic 
of this beginning phase include: the identification and diag- 
nosis o^ a need or a problem in a comm\inity; -the identifica- 
tion of an objective; selection of an auspice; the design 
o^ a structure, Vhere there seems to be more variance is 
with regard to the following: how projects begin; the type 
of leadership demonstrated; the development of a tonceptual 
framework; the participation and involvement of consumers, 
exp6rts, other lay people and community organizations; who 
develops the formal proposal where one is submitted and the 
length of time between submission and actual funding. 

Establishing a project takes about one year. Once 
the process is begun, structuring the organization should 
be completed at the end of about six months. That is, an 
office shoxild be obtained, most staff, in particular admin- 
istrative, supervisory and line staff, hired and trained, 
and soipe community activities completed. Beginning in these 
first six months but completed by the end of the first year, 

first targets and strategies are generally identified, clien- 

V 

tele and referral sources contacted, specialist staff hired, 
first services provided and community participation expanded. 
If an Appointed board is planned, this too is, generally organ- 
ized, convened and meeting regularly by the end of thp first 
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year. 

For example, by the twelfth month, twenty-two pro- 
jects were providing some form of direct service. Of these, 
twelve were providing access services and six had begtin data 
collection or a community survey. Eleven projects l^d begun 
provision of case advocacy. Of this group, one begaji class 
advocacy also and one other began class advocacy first 
(through its legal component). 

The greatest variance occurred during this period 
. with regard to whether the project director hired was some- 
one who had been actively involved in the beginning activi- 
ties; whether or not specialized professional staff were 
hired (lawyers, psychologists, teachers, social workers, re- 
searchers); the nature and extent of staff training; wW?ther 
boards were elected or appointed, advisory or policy-making, 
active or inactive; the extent of staff turnover; whether or 
not administrative structure, staffing patterns, programs ' 
generally, were reorganized and why; whether roles were re- 
defined and why; the number and Mispersion of targets addres- 
sed and whether or not case or class advocacy was provided 
and when. 

% Operationalizing a project begins in the first half 

of the second year of a project's life. By the eighteenth 
month, case advocacy is provided regularly and where there 
is a legal component in a project, class advocacy Is provided 
also. During the remainder of the second year project goals 
O ^ are refined further and beginning efforts are made regarding 
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the formation of ^oalltlons composed of other organizations 
or group© in the community. Where boards are elected, these 
^ are convened and arfe meeting regxilarly by the end of this 
period. Some Interest in evaluation 7 the documentation of 
achievements and feedback related to the Impact of project 
activities begins to be evinced at the end of the second 
year. 

Finally, although the experience is limited here and 
conclusions are at best tentative, projects appear to be 
fully operational sometime d\irlng their third year. Where 
feasible, some may begin to attempt replications or the es- 
tablishment of satellite or duplicate projects. Three have 
begun this, however, thus far, only one has been successful. 
It generated the establishment of eight community projects, 
seven of which have been in existence between one and two 
years. At this point, the few projects that have lasted 
this long are once again_c one ent rated on problems of organ- 
izational maintenance, in particular, a search for additional 
funding in order to ensure continuity. 

The next chapter will begin with an attempt at fur- 
ther conceptualization of the developmental phases of these 
projects. This will provide a basis for first efforts at 
comparing and contrasting the activities characterizing pro- 
jects which are obvlo.us ^Wmt^s and those which are ongoing 
community child advocj^ly projects. Following this, the fo- 
cus will shift to the Issue, of criteria. Indicators and evalu- 
atlon points. 
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CHAPTER V 

PLANNING, INITIATION, IMPLEMENTATION, CONTINUITY: 
A CONCEPTUAL FRAJ4EW0RK FOR PROJECT DEVELOPMENT 



The last chapter described the nature and extent of 
the activities performed by child advocacy projects during 
^ their first two and one half years and gave some Indication 

of when theee occurred and how they appeared to cluster In 
certain periods of time. This chapter will be devoted to de- 
veloping a conl^eptual framework for the process. Conceptu- 
alization of developmental stages and tasks Is essential to 
derive an evaluative Instrument that may be applicable to 
all community child advocacy projects, not Just the group 
studied. The chapter begins, therefore, with a review and 
discussion of the literature conceptualizing organizational 
development, to see If any existing theoretical schemes are 
relevant for orde^ng the process In chlld^^advocacy projects. 
Since the use of a familiar vocabulary will facilitate under- 
standing, communication and the use of the evaluative instru- 
ment, utilization of existing concepts Is preferable to de- 
veloping new ones. There may be some difficulty In applying 
these theoretical frameworks to the data because the exist- 
ing schemes were developed. deductively rather than Inductively. 
Thus, where theory does not fit reality, certain concepts may 
not be useful. Regardless, exploration of existing theory Is 
essential to select out what Is most relevant for what has 

erJc ccisa 



126 



now been described empirically. 

SOME CONCEPTUAL FRAMEWORKS FOR ORGANIZATIONAL DEVELOPMENT 

Earlier (Chapter II), mention was made of an 
approach to differential evaluation that appeared to have 
relevance and applicability for child advocacy projects.-^ 
This conceptual framework Identified three stages for pro- 
gram evaluation: progreim Initiation; prograim contact; and 
program Implementation. Since this approach Is derived from 
studies of organizational development, a summary of this 
literature will be helpful before assessing Its possible 
relationship to what has been derived empirically from the 
projects. 

Hage and Aiken, from whose work the above framework 
Is derived, actually Identify four phases In program devel- 
opment^: evaluation. Initiation, Implementation and routlnl 
tlon. Evaluation encompasses the Identification and study 
of an existing need or situation and a "diagnosis of the 
problem. Initiation Involves designing the new program: Iden 
tlfylng objectives and alternative strategies for achieving 
these objectives, searching for ^^esources - human, financial 
and physical - to support the proposed plan. Implementation, 
the third stage. Involves taking the plan as designed and 



^Trlpodl, Fellln and Epstein, og^. clt. 
2 

Hage and Aiken, 0£. clt. 
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putting It Into action, making It operational. Finally, 
routinlzation Involves stablllzataon of the program (Im- 
piled here ia achievement of objectives. Institutionaliza- 
tion of the progriBun, and the ability to continue even if 
and when leadership changes). 

In contrast to this, Lawrence and Lorsch suggest 
five stages^: diagnosis (identification of a problem or 
nefed and determination of the relevant causative factors); 
design (delineation of* objectives and of an organizational 
structure to Implement them); action planning (the develop- 
ment of alternative strategies and change methods for 
achieving the above objectives and determining their se- 
quential implementation); implementation (translation of the 
plan into action)^; and evaluation (the end of the first cy- 
cle or organizational development and the beginning of the . 
next; the comparison of the actual results with what was 
anticipated and diagnosing the variance and its causes). 

As indicated earlier, the framework developed by 
Trlpodl, et. al., seemed highly relevant, initially ,^ to the 
current study. However, since this study vms deliberately 
designed to employ a developmental methodology - to study 
a developmental process - it seemed appropriate to view the 
life history of these projects empirically first, seeing whe- 
ti^r there were natural stages through which projects devel- 
oped, before applying a conceptual framework. Empirical 
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analysis of the matei\lal and consideration of the conceptiial 
frameworks reported ib the literature siiggested that the best 
fit might be found by enqploying a three stage model involving 
these categories: Planning, Initiation, Implementation. What 
follows reveals how this model evolved and why these concepts 
were selected. 

Planning 

In reviewing the creation of these child advocacy pro- 
jects, it is immediately apparent that all activities re- 
lated to beginning a new project involved a per±^d of time ^ 
and a cluster of tasks quite distinct from the actual opera- 
tion of a project. The distinctive nature of this phase is 
heightened for eighteen of thesd projects because this pro- 
cess culminated in the preparation of a forma.1 proposal. 
In addition, for most, there was a hiatus between the com-' 



pletion of planning ajid a beginning effort at establishing 



a project. For three to slj(;^months, almost all activity on 
the project ceased, while planners waited for notification of 
grant awards, ^hus, for many projects there is a fairly 
clear cut line of demarcation between planning and establish- 
ing a project. Indeed, if this hiatus is too prolonged, 
some regression may be observed in later development. For 
example, these first activities provide a certain momentimi 
for establishing a project. If too long a period of time 
elapses, the developers may become involved in other activi- 
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ties; 'their corrmiitraent to the project may be diluted; simi- 
larly, community interest may s^ift or wane; unforeseen fac- 
tors or problems may arise. ^ 

In effect J the proposal as a formal document re- 
fleets an holistic process. Where the plan is not written 
down, this^j process may be more difficult to assess; regard- 

i 

less, this/ then .appears to be the first stage in the' creation 

* / 

of a child advocacy project. S 
j For the group studied, the process was generated by 

one of fc^ur factors: the concerns, efforts and ideas of in- 
divldxials; the availability of new funds for a specific type 

0 

of project; the efforts of the sponsoring organization to 
obtain addl-pional fuil^s for its own use; a specific grant 
of money from a funding agency for tjje development of a plan. 

Once action is talwii "to begin a new child advocacy 
project, subsequent tasks acc^pmplished during this period 
include: " - 

- The determination and dociomentation or ^a need or 
problem in the community. 

- The delineation of a specific target community and 
a target population. • . 

- The participation of a wide range of interest groups 
In the community: consumers, experts, influentljJL 
lay people, organizations. 

- Specification of objectives or goals. 
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- The choice of targets for Intervention, levels of„ 
Intervention and Interventlve methods and techniques. 

- The design of an appropriate structure. 

- Selection of an auspice or obtaining the support 
Of the existing adndnlstrjsttlve structure for a 
new program component. 

- The search for funds. 
In atten5)tlng to conceptualize this process Lawrence 

and Lorsch Identify three separate stages which all relate 
to these activities: diagnosis, design ajnd action-planning. 
Diagnosis Involves determination of needs or problems: de- 
sign Involves specification of goals, process and structure; 
action-planning Involves Identification of targets for 
chaiTge, change methods and Interventlve strategies, and 
planning for the sequential development of Inqjlementatlon. 
Hage and Aiken include all of the above in the stage called 
evalixatlon as well as in a portion of their second stage, 
initiation. Trlpodl Includes these within the stage of pro- 
gram l^tlatlon, but adds such other activities as obtaining 
physical, financial and humem resources in addition to es- 
tabllshlng an organizational structure. In viewing the life 
history of these projects, this last group of activities 
appears at a distinctly different period of time. Williams 
refers to 'this cluster as program design, however, this 
seems to be too static "a concept to encompass the variety 
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of processes and activities accomplished in this phase.*** 
None of the stages conceptualized above seems to appro- 
priately capture, the whole process followed by these pro- 
jects. 

In contrast to the above, Kahn^s planning paradigm 

does seem relevemt for conceptualizing this phase of . project 

2 " - 
development. Included in his concept of the planning pro- 

if 

cess are: planning instigators, e^cploration of relevant 
realities and preferences, definition of the planning task, 
policy formulation and programming. Planning instigators 
are what stimulate and initiate the planning process. 

His concept of the definition of the planning task 
encompasses a process by which, objectives are arrived at in- 
ductively, through the exploration of relevant facts and an 
assessment of values and preferences. An adequate investi- 
gation implies the presence of those activities identified 
in the last chapter as integral to beginning a child advocacy 
project: widespread involvement of vthe relevant community, 
consumers as well as well as appropriate experts. Essential 
to the careful definition of the planning task is the inte- 
gration of facts, preferences, and political feasibility in 
order to determine viable objectives. In fact^ according to 
Kahn, it is this inductive process by which objectives are 
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defined rather than the arbitrary ^ determination of objec- 
tives and subsequent search for solutions that is so cru- 
cial to this phase. In effect, clear definition of the 
plaj)ning task delineates the mission of the project, an 
essential ccxuponent of planning as well as program develop- 
ment • 



tion. It is analogous to the action planning phase of 
Lawrence and Lorsch 6uid involves the identification of tar- 
gets for intervention, levels of intervention and inter- 
ventive strategies. Finally, progr^jmning focuses on de- 
signing the program, which then has to be made operational. 



the first phase in the creation of child advocacy projects, 
may be encompassed within Kahn's concept of planning . As 
mentioned earlier, for most of the projects studied, ^the 
process took between six and twelve months. Whether or not 



of the plam, or what the critical variables are in this ^hase 
remain as yet unidentified. 

One final note about the planning phase. One task, 
obtaining community participation and involvement, was des- 
cribed as "difficxilt to achieve" in certain types of communi- 
ties, by several directors. In partictilar, those communities 
which are characterized as fragmented, having no sense of 
V community identity or cohesion, with no indigenous leadership 



Policy formxilation provides a general guide to ac- 



Thus, all tasks already identified as integral to 



the amount of time 




plajining relates to the adeqxiacy 
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or community organizations, require initial effort at 
organizing before they can be mobilized to support or" 
even utilize a child advocacy project. Communities that 
have seen a large number of federal programs come and go 

* 

tend to be equally suspicious of a new projeft. (Such 
hostility to federal programs as well as other conseque^ices 
of short-term federal funding, will be discussed further, 
in Chapter VIII) Special efforts are required to arouse the 
Interest and support of such communities. Communities Which 
have been subjected to several research studies by univer- 
sities or teaching hospitals seem to be equally hostile to 
projects sponsored by such institutions. In addition, ad'- 
vocacy interventions \diich begin with a survey of community 
needs often engender immediate negative reaction by communi- 
ties that have been studied and restudied and want to see 
action and not further study. For such commxinities, a plan 
involving an initial survey may immediately "turn off" the 
community and result in limited involvement and support. 
Finally, communities i^ich are substajitially deprived economi- 
cally - with extensive poverty and high xinemployment rates - 
often viewed child advocacy projects as irrelevant to their 
priorities. Projects did not receive their support unless 
goals were relatively precise and clearly relevant to immer 
diate needs. Thus, the nature of the target community may 
need to be carefully considered when planning a child advo- 
cacy project. 
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Initiation 

The second I stage in the development of TITlld advocacy 
projects begins for most when they obtain funding. Actlvl- 
ties related to establishing a project begin when a decision 
Is made to go ^ead either because It has been funded; It 
has been authorized to plan by a funding source or sponsoring 
agency; or>a group of people have decided to organize a pro- 
ject. For the three proJ,ects without formal funding, two 
had staff assigned to begin operations and one decided to 
proceed on a volunteer basis. 

This phase encompasses part of what Trlpodl and Hage 

and Aiken term Program Initiation - the search for financial, 

i 

physical and hunan resources to Implement the proposed plan. ^ 
Similarly, it encompasses all of whsit Lawrence and Lorsch 
call Ijnplementatlon or translating the ]^aj\ into action. . It 
begins where Kahn's concept of the p'lrogramming phase of 
plauining ends - in other words, after the program is designed - 
with the first efforts at operationallzing the program^ 

In reviewing the experience of child advocacy projects, 
' it appears that there is Ibl definite distinction both in time, 
focus, nature of activities and of the effort expended by 
the staff, between getting the program organized and established 
and its actual operation. Williams uses the t^rm project 
organization to describe the time when the project concpntrates 
on internal organizational development, placing less em- 
phasls (although some is essential) on external development. 
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It involves the recruitment and hiring of administrative, 
supervisory and line staff (generally this is done se- 
quentially) ; obtaining an office; training staff, recruit- 
ing and orgajiizir^ a board; identifying and mobilizing a 
constituency; contacting other agencies and explaining the - 
nature of the new project; identifying short-term goals 
and objectives ajid ranking them; specifying first targets 
for intei*vention and first strategies. 

Some of these tasks are sequential (e.g., hiring an 
administrative staff who recruit, then hire line staff; then 
train staff); some are simultaneous (while staff are recruited, 
hired, and trained, the community is involved through the 
process of recruitment of staff and board members as well 
as through the use of other agency representatives as re- 
source people for training.) 

Prograiti Contact is the second stage described by 
Tripodi, who employs it as a separate phase for evaluation 
purposes. In studying the life history of these projects, 
it is obvious that this phase involving contact with potential 
prograjn beneficiaries, is not chronologically distinct from 
other stages. Quite the contrary, in several projects, what 
might be described as consximer participation or consumer 
involvement is integrated into every phase from planning to 
operationalizing a project. Thus, treating it as separate 
and distinct, indeed as anything else but a task for each 
phase, v/ould be both dysfunctional and invalid. 
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For child advocacy projects, this phase, termed 
Project Initiation , involves both structuring the organic 
zatlon as well as initiating first actions and services. 
Among the major tasks addressed are: 

- Integrating the organizational npLLssion into the 

0 

framework of the project. (The commitment of 
leadership to projefct objectives j training of 
staff). 

- Establishing an organizational structure that will 
facilitate achievement of objectives. (Hiring 
staff , establishing boards, defining roles) 

- Obtaining sanction and legitimacy for the project 

' ■* 

(the identification, organization, and mobilization 

*^ 

of a constituency, accomplished by such means as: 
recruiting and hiring indigenous staff, organizing 
boards composed of community representatives - lay 
and/or professional; establishing linkages with 
other community organizations.) 

- Specifying goals, in particular first targets for 
intervention and interventive strategies. 

]^ - Beginning provision of services. 

This phase takes about one year to completed In 
general structuring the organization (obtaining an office, 
a hiring staff, training staff, first efforts at community 

^ involvement) takes about six to eight months to complete. 

- COM 4 
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Identification of first targets and strategies may begin 
during this period, however. It Is completed and services 
and other related activities are first provided after 

another six months. \ 

I \ 

Implementation 

Operatlonallzlng new projects. In other words com- 
pleting activities related to the Initiation phase as well 
as the next group of activities, was Inevitably longer than 
project directors anticipated, Sarason, In his study of 
the creation of new settings, comments: 

I have never talked to a leader of a new setting 
who did not say that he had vmderestlmated how 
long It woxild take for the setting to become 
operational. Some of the leaders said they had 
vastly \inderestlmated how long It woxild take and 
that this had adverse personal and organizational 
consequences .1 

The start-up time for projects located In poor 
communities, with Indigenous paraprofesslonal staff may take 
longer than anticipated because staff lack expertise and ex- 
perience and require additional time for training to develop 
this. • 

^ PJpoJects that have an Innovative conceptual frame- 
work also appear to requite longer to Implement than more 
conventional programs. Related to this, projects that pro- 
vide traditional case services tend to begin service provlsl 

Isarason, 0£. clt . , p. 201, Footnote. 
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earlier than those that concentrate on advocacy activities^ 

In general, coramxinlcatlng this new conceptual frajnework to 
staffs training them In new roles, explaining the new pro- 
ject to the community and finally, translating It all Into 
action, requires adequate If not extensive time. 

Finally, projects that have widespread commtinity 
Involvement In the planning and Initiation phases, and 
projects In which staff as well as directors participate 
In decision -making, all take more time to become operational 
than others. Whether or not these factors also appear to 
result In more effective Implementation once that stage Is 
achieved, remains to be seen. 

Implementation Is defined by Lawrence and Lorsch as 
the phase In which the action plan Is translated Into action; 
by Hage and Aiken as the stage In which the program becomes 
operational; by Trlpodl, similarly, when programs are fully 
operational and outcomes can be Identified and measured. 

Similarly, for child advocacy projects. Implementation 
is the stage In which the project becomes operational. The 
major characteristic that distinguishes this from the ear- 
lier phase Is that the stress here Is on the project's ex- 
ternal relationships, rather than on organizational main- 
tenance. It begins once the project Is fully structured and 
beginning to provide seinrlce and ends when the full comple- 
ment of advocacy services planned for are provided; when 
those projects defining "systems Intervention" or class ad- 
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vocacy as a goal, are In fact able to implement it; when 
the project's major effort Is on programming rather than 
organizational maintenance; when more than half of staff . 
timeJlB going toward the provision of advocacy services; 
when advocacy activities constitute a major portiion of the 
program; when the project caji be successfully duplicated 
elsewhere; when goals are sufficiently specified and de- 
fined in measurable terms. 

Among the tasks for this phase are: 

-^Retaining commitment of leadership and staff to 
the project's mission. 

- Strengthening and expanding the sanction for 
advocacy. 



- Effective and efficient use of project energy: that 
is concentration on advocacy activities and limit- 
ing the number and dispersion of targets addressed 
and strategies employed. | 




- Provision, where planned, of case advocacy. 



- Provision, where plauined, of class advocacy. 



- Integration of a series of devices to ensure con- 



sumer and community accountability. 



- Beginning efforts at replication of a project. 



- Documentation of achievements. 
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Implementation for those child advocacy projects 
completing this phase, begins sometime during the second 
year after funding and takes approximately one to two 
years to conqplete. Only two of the projects studied cur- 
rently appear tp have achieved fully operational status 
and those are two of the oldest projects studied. Even 
they have expressed some question as to whether they have 
really obtained that status. (Indeed, an interesting note 
is that directors of those projects that appeared furthest 
along towards implementation tended to raise the most 
interesting questions about the operational status of their 
own projects . ) 

This 'implementation phase of project development is 
crucial for evaluation purposes since until this phase is 
completed, evaluation of project outcomes or impact is im- 
possible. Williams stresses the importance of this pro- 
cess, saying: 

The question of Implementation is one of the 
most fundamental of all the issues facing a 
large-scale organization. In its most gen- 
eral form, an inquiry about implementation 
capability (or, more accurately, specification- 
implementation) seeks to determine whether an 
organization can bring together men and material 
in a cohesive organizational unit and motivate 
them in such a way as to carry out the organiza- 
tion's stated objectives.! 

Whether or not a program ever achieves this stage 

of being tully operational" (or fully implemented), is the 

■""Williams, Social Policy Research, p. M 




14L 



crucial question for' outcome evaltiatlon purposes. Deter- 
mlnation of what factors Influence the project's capacity 
for reaching this stage Is thus pf enormous Importance. 
Williams suggests the Importance of program design and 
' specificity, the development of a sjouhd organizational struc 
ture and the presence of competent leadership as criteria 
for evaluating this capacity.^ In effect, h^ has Intro- 
duced an Initial ilst or prerequisites essential for pro- 
gram Implementation. Viewed within the framework of a develop 
mental process, as tasks for different phases within this 
process,, one can study how this capacity dev61ops - which 
factors contribute to Its existence and/ which will Impede 
Its development. 

Contlrtulty 

Finally, what happens once a project achieves this 
statu^and Is defined as fully operational? How^ls effec- 
tive performance demonstrated? 

Lawrence and Lorsch describe a stage called routlnl- 
zatlon In which the developmental process afchleves Its 
objectives and seeks validation through Identification of 
measures of performance or effectiveness • It Is ut this 
point that outcome or Impact evaluation Is viable. 

There does not appear to be any such phase for the 

^ Ibld >, pp. 1^t1^5 
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projects Included in this study. As the period of formal 
funding comes to a close and often during the whole year 
pripr to this, much of the project's effort is devoted to 
finding new sources of f\inding in order to stay alive. 
This fight for survival has overwhelmed at lea^t one pro-^ 
Ject, leaving staff frustrated and Impotent and leaving 
a legacy of anger, bitterness, and resentment In the 
community; (For the fortunate few that manage to survive 
by scrounging additional funds from a variety of sources - 
and some of these were seen during the course of our last 
study - advocacy projects that are now five, six or seven 
years old - each year Is viewed as a possible last and con- 
stant energy goes Into fund raising. ) K 

Only two of the projects Included In this study are 
at this stage; and it is highly probable that funding will end 
for one Just as it achieves it. Since short-term funding 
is characteristic of mo^t federal projects, and of all child ■ 
advocacy projects, a major issue for all of these is the in- 
appropriate time frame employed for outcome evaluation. As 
evidenced by this grpup, projects can rarely become fully 
operational In much less than two and a half years and out- 
^ come and Impact evaluations cannot%e Implemented with vall& 
expectation of measurable re siilts before this time. 

Summary 

In summary, this chapter has reviewed existing theories 
Q of organizational d^elopment and selected those concepts which 



143 



seem mos% relevant for the current study. Three develop- 
mental stages have been Identified": planning, initiation 
and implementation; and the major tasks for each phq^se have 
been described • A fourth phase, continuity^ has beeif* sug-| 
gested, however, none of the projects in this study have 
reached this 'stage • Although this may be a consequence, of 
the age of the projects included in this study^ it is quite 
possible that the nature of the advocacy prot?5fess Is sUch 
that project continuity is neither feasible nor desirable. 
On, the other hand,' it Is equally possible that the nature 
of available funding precludes project continuity* Data 
available from this study does not permit ajiy conclusions 
here* Based on thisse phases and their relate^ tasks, the 
next dhapter will attempt to identify developmental standards 
and tentative criteria for evaluating child advc&acy pro- 
. Jectp at each stage. 
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CHAPTER VI 

DEVELOPMENT OF AN INSTRUMENT FOR DIFFERENTIAL EVALUATION 

\ 

is 

Although outcome and Impact studies face obvlpus 
problems, an extensive body of theory and knowledge al- 
ready exists regarding this approach to evaluation. As- 
suming the validity of the definition of child advocacy 
developed earlier (see monograph) such evaluation studies 
would require the translation of this definition Into ob- 
jective, measurable criteria. For example, potential mea- 
sures of Impact for class advocacy, might be: changed laws, 
revised budgets, personnel change j for case advocacy, these 
might be: service obtained for a child who has been refused 
service, reinstatement of a student Vho has been Inappro- 
priately suspended from school. 

The difficulty In using such impact measures early 
In the history '|Bf child advocacy projects Is that)^ when one 
looks at child advocacy pr(?Jects In "real life," they take 
much longer to develop than most researchers, administrators, 
arid project directors realize, and certainly much longer 
than Is generally anticipated when the project first begins. 
Impact studies at this point In time would make no sense 
for almost all of the projects studied, yet obviously It Is 
essential to have some Idea of how well they are doing en 
route: How far, along Is a project to becoming operational? 

m 0 0152 
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How does it compare with other similar projects at the same 
point in time? What Is the likelihood of its becoming an 
"effective''^ child advocacy project?. For federal agencies 
such information is crucial, since decisions must be made 
annually regarding refunding of projects, or directing pro- 
jects to make changes in programs, leadership, auspices, if 
they appear necessary - even though impact and effectiveness 
measures would be premature at the point when the decision 
needs to be made. 

Thus, the issue becomes: how does one evaluate a 
child advocacy project after six or twelve ox; eighteen 
months? What criteria can be employed that would permit 
such interim evaluation? Essential for the development of 
such interim "process" criteria, is a definition of what ul- 
timately is a "good/* "effective," or "successful" fylly 
mature child advocacy project. The present study represents 
an attempt at developing such criteria inductively. Since 
very few of these projects are actually fully operational, it 
is particularly difficult at this point to identify criteria ^ 
suggesting "impact" sucofess and to work backwards with great 
precision. However^^^ we can differentiate "tAe possibly 
successful" fro.'C^he clearly unsuccessful" projects^ we may 
be able to formumtfe criteria of danger or failure relevant 
to those stages <5r organizational development in which impact 
studies would be premature. For this purpose, although it is 
difficult as yet to arrive at any completely firm, positive 

V 
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y Judgements regarding successful child advocacy projects, one 
con make a rough categorization of "failure," by identifying 
the projects that are obviously unsuccesi^fUl. For example, 
the directors of three projects openly aclcnowledged that 
their projects were not child advocacy at all; two others 
have readily admitted they have no identifiable program after 
over one year, and one of these is providing no service at 
all; three more have stated that their projects are "in dif- 
ficulty," are unclear as to the cause but have doubts about 
the value and continuity of their enterprise. 

In short, for a first approximation of "failure," 
there are eight projects, as follows: 
Non-Advocacy Projects 3 
Projects with No Program 2 V 

Projects in Difficulty 3 ' 

Although the non-child advocacy projects and those with 
no service or program after one year, are obvious failures, 
the third category is less clear-cut. Acknowledgement of 
difficulty may be a fxinction of a project director's honestj?^ 
thus, these projects may be no less successful than others. 
Just more open about admitting it. Regardless, the group 
does provide a point of departure for further analysis, for 
seeking indicators of what is (or was) to come. 

Identification of these eight as "failures" leaves 
a group of f if teen^ projects which by default would be con- 
sidered more or less successful or at least, preliminarily, 
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as "non-failures." ^Since none of the 'eight projects by 
defibition has reached the third phase of development, im- 
plementation, nothing can be learned about that phase from 
this group. However, if one reviews the life history of 
these eight up until that point, and compares the activi- 
ties performed by them with those of the "non-failures," 
one might begin to hypothesize about some possible correlates 
of failure and some tentative indicia of difficulty in each 
phase - some tentative prognosticators of problems in later 
phases . 



ACTIVI TIES CHARACTERISTIC OF EIGHT "FAILURES" 
himm THE PLANrlING AND INITIATTOn PHASES 



Non-Advocacy Projects 

Of the three projects that acknowledged the inappro- 
priateness of the child advocacy label, one was labeled as 
an advocacy project by the funding agency, unbeknownat to 
the project. It is a research and demonstration project 
that provides day care for the infants of teenage mothers. 
Neither in the proposal, in actual practice^ nor in an inter 
view with the former project director is tfifere any mention 
of child advocacy. The funding agency's purpose in categor- 
izing this project as "child advocacy" is unclear. However, 
the obvious inappropriateness of the categorization is appar 
ent as early as in the formal proposal. Tjfie absence of any 
reference to advocacy ^ in any material related to the plan- 
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ning of the project let alone in actual practice, would im- 
mediately exclude it from any evaluative study of child ad- 
vocacy projects. . • 

The second is a f€unily advocacy project in i€hich the 
director stated that the label was affixed to the project by 
its sponsoring organization^ a family service agency. The 
term "family advocate" is used in the proposal, but it is 
never defined. The role, is described as traditional casework 
and the objectives specified \.n Xhe proposal all relate to 
direct service provision and coordination. Neither the 
director of the project nor the "family advocate" was in- 
volved with the project when it wa;ar planned. Neither knew 



anything about ^how or by whom the proposal was prepared; 
therefore, neither knew whether any of the participants had 
any clear concept of advoca^cy or why the label was used.*^* 
Both were totally unfauniliar with the concept or what its 
implications might be for prograjnming. The project is a 
neighborhood service center, has been operating for about 
one and a half years. Advocacy activities as such are not 
defined as any part of ^the program, which provides inf o^TMition 
and referral services, counseling, tutoring and a variety of 
other services (e.g., employment counseling, food stamps, 
emergency public assistance). 

The proposal for a third proj^t does spell out an 
advocacy concept, identifies a role for older youth advo- 
cating for younger, cmd describes a training program to pre- 
pare inexperienced youths for $his role. Neither the director 
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nor th^ assistant director was Involved In the planning 
phases The sponsoring agency, which had first so\Jght 
funding for the project ,tf^as In the process of political 
reo?*gajilzatlon and thus, no effort was made to establish 
the project for one year subsequent to funding. No staff, 
' ^^"^ administrative or otherwise, were hired until then. During 
the Initiation phase, the training program was first Imple- 
mented, then changed and then partially eliminated. In 
particular, the focus on advocacy was eliminated. It was 
described by the director as not really relevant to the core 
of the' program which provides recreational, tutoring and 
counseling services. In addition, a major objective of this 
delinquency prevention project as stated In the proposal, 
was the active Involvement of youth In planning and making 
policy for the project. This was to be implemented first 
by the establishment of an advisory board compoaecf of mem- 
bers elected from local high schools. After one and a 
half years, this board has not been organized because the 
youths are described. as "too radical." Currently, efforts 
are being made to recruit board membership from among those 
youths regularly attending the various project centers. 

Projects With No Program 

One project is providing no services of any kind 
after almost one and a half years. The project was planned 
and the proposal developed by the staff member of a voltin- 
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tary agency. She resigned Just at the time that the proposal 
was funded.^ As proposed, the project was to organize parents 
professionals, and influential lay people into a volunteer 

N 

group which would focus on class advocacy in the community, 
in particular, around the mental health or related needs of 
children' and their families. Monitoring of existing service 
systems, lobbying and related activities were to be imple- ^ 
mented by citizen volunteers in a county that has been char- 
acterized as unusually "disparate" with a large population 
of physically mobile blue collar workers, a -small upper mid- 
dle class and professional ^roup, and a largely underser- 
viced and segregated chicano community. Several parents of 
handicapped children participated in the initial planning of 
the project. N6 other parent groups or organizations in the 
community were involved during this phase. In addition, the 
Membership of the existing voluntary agency that was spon- 
soring the project, did not participate in the planning pro- 
cess and were unfamiliar with the proposal until it was 
funded. 

Among the first activities performed once the project 
was initiated was the establishment of a policy-making board 
composed primarily of parents of handicapped children. How- 
ever, the nature of the handicap varied. Intense conflict 
erupted among board members as to which handicap required 
greater advocacy. During the seven months that the board ex- 
isted, no agreement was reached regarding priorities for the 
project; and finally, the director dissolved the board. Sub- 
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sequently, a more widely representative board was appbinted 
but there is still no agreement as to the first focus for 
, this citizen group* 

Another project v;as planned as an internal advocacy 
program, to monitor the services of a large instJ^tution as 
it related to children.' The project has no separate funding; 
instead two staff members were assigned to it from other parts 
of the progi:am. No specific problems were identified dur- 
ing the planning phase, but merely a general concern with 
the unresponsiveness of the institution to children's needs 
and their low priority generally. No objectives were ever 
identified, nor v/as there any indication of how services were 
to be changed if the staff identified problems or policies 
needing to be changed. No commitment of higher administration 
was ever obtained for the support or implementation of the 

/ 

project. \ 

When the project was initiated, staff were left on 
their ovm to decide how to progress. No training, supervision, 
clarification of objectives or designation of strategies were 
forthcoming. Staff were unclear as to their roles and so was 
the target system that they were addressing. Thus, other 
staff perceived them as "spies for the administration" while 
^ the administration defined them as low-level staff and equated 
them v;ith their peers. One staff member, after about one 
year, became completely involved with providing services on 
a single ward and its r^ated out-patient service. The other. 
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vftii^ was to be involved with neighborhood health service 
proj[^cts, is providing direct services^ there in jtddition 



to s6}^e community organizing activities. After the first 
year, the project staff no longer (Jefined it as an effort 
at internal advocacy. , The institution is described as "too 
large and too complex to be changed." None of what was 
planned has been initiated. 

Projects in Difficulty 

Three projects described themselves as "in difficul- 
ty" after sixteen months. One of these was designed to be 
a "community development model of child advocacy" which de- 
pended heavily on ,comm\inity participation and involvement 
for its initiation and implementation. A prior proposal had 
been prepared by the , sponsoring organization with an objec- 
tive and a design tJ>at the commvmity supported. This pro- 
posal was re^Jected by the funding agency which then suggested 
\ tha€ a proposal be submitted for a "community development 
lodel child advocacy project." A professional proposal wri- 
ter was hired to prepare the proposal and it was subsequently 
submitted ajid approved for funding. No consiimers, relevent 
groups, or organizations in the community were involved In 
the planning process and the principal investigator has des- 
cribed the proposal as "poorly designed" with broad, diffuse 
objectives and no clear ihdic^tion as to hoH^ these were to be 
achieved. It was prepared to meet funding agency guidelines. 
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When the project was initiated, staff were trained within 
a few days and services vrete provided v/ithin the first few 
months. Staff were unclear as to objectives and roles; they 
tended to view the project as a source of enployment. Ser- 
vices ^fitt^are provided include information and referral, 
some "counseling and some community organizing. When inter- 
viewed about advocacy activities, staff were unable to des- 
cribe ajny case or class advocacy. 

The last two projects are \inusual for this cate- 
gory of "failures" in that they placed^ great stress on con- 
sumer involvement and participation dumng the planning phase. 
One is the project described earlier that assured the com- 
munity of the establishment of a child advocacy project well 
before funds were obtained, organized elections for lay 
and professional board members and convened the board. Leader- 
ship was active throu^out the planning process; there was 
widespread involvement of relevant interest groups in the 
community. The i)roJect * s design is very similar to that of 
another child advocacy project in the same city, one that is 
included in the "non-failure" category. If anything, this 
project accomplished more numerous and more extensive activ- 
ities than most of the othef* projects diiring the planning 
phase. 

What happened during the initiation phase which thus 
far has precluded the project from becoming operational? 
First, leaders, who had been actively involved in planning 
the project, withdrew from the leadership role at the onset 
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at that time. Close to one and a half years after fiinding, ^ 
this project still was not operational. 8nly after addi- 
tional time elapses will it be known whether this major 
administrative reorganization wili facilitate the process 
of ope rationalizing the project. 

The last project included in this group "in diffi- 
culty'^ is one in which the leaders worked closely with the 
major organization in the community to develop a proposal 
that would satisfy consumer needs and wants. The project 
is designed tc^ implement changes in the local school system. 
^ The design of the project eschews a conflict model and em- 

ploys instead a ansensual-cooperative model for implement- 
ing such change. However, school administration and rele- 
vant personnel did not participate in planning the pro- 
ject. Neither during the planning phase nor during the 
Initiation phase were objectives specified. A major problem 
for the project is that the community perceives it as fxinc- 
tioning in an adversarial role vis a vis the school, and 
sees it as inadequate in this role; while the school views 
it as adjunctive to its system, and resists any efforts at 
intervention. Both project and school staff were unclear 
about advocacy sta(ff roles, and after more than one year an 
impasse was reached. Concerted efforts were made to clatify 
staff roles; however, school staff still did not concur' 
with those specified. Several months later, objectives and 
strategies still were not specified. One conclusion reached 
l^y project leadership is that the target is to6 powerful and 
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of the initiation phase. Instead they asstimed an advisory 
and consultant role. The elected board took on responsibil- 
ity for making all policy for the project and recruited and 
hired the director and staff (althougha full complement of 
staff was never hired during the first year). The project 
director employed was someone who had been completely \in- 
related to the planning process earlier and who was dominated 
by the board which continued to maintain complete responsi- 
bility for major policy decisions. Neither staff nor di- 
rector had any input into decision making. Furthermore, the 
board itself v;as composed of members who had conflicting 

4 

ideas about policy. No decisions were reached during the 
first year about action targets and strategies; staff were 
often given conflicting directiohs by thQ board and project 
director. The consequence was that most of the first year 
was spent coping with intra-organizatlonal' conflict . Although 
some information, referral and counseling services were pro- 
vided, advocacy activities were not implemented and no clear 
objectives or priorities were ever delineate. Before the 
end of the first year, when it came time for elections to be 
^ held for the board, the principal investigator intervened. 
Several staff members were discharged; new ones hired; the 
remaining staff positions that had been open all year were 
filled; the board v;as left temporarily vacant; ajid the policy- 
making role was assumed by the principal investigator. After 
four months, a new board was elected including none of the 
earlier members. Only limited authority was assigned to it 
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the strategies too diffuse for changing the school. An alter-/ 
native conclusion Is that the staff did not have the skills 
necessary to Intervene In such a con^lex target system. 
Based on the experience of this group of eight 
tentatively labeled "failures" the following summarizes the 
activities (or lack of activity) that appears to be charac- 
teristic. This list Is organized In such A way as to Indicate, 
first, how and when one can recognize that a project Is not a 
child advocacy project; and second, what the Indicia might be 
for "difficulty," "problems," or "failure" In either the 
planning or Initiation phase, 

INDICIA OF NON-ADVOCACY 

In the Planning Phase 

1) No use of the term "child" or "family advocacy" 
in the proposal, memorandum or other planning 
document . 

2) No Indication that any of the planners defined 
the project as a child advocacy project (e,g,, 
a statement^ by the project director that child 
advocacy was never discussed as relevant to the 
project) , 

3) Use of the term "advocacy," but no definition 
of what Is meant by this. 
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^ 4) Inappropriate use of the term^ for example > to 

describe traditional service roles or direct 
w " . services. 

^ 5) Absence of any .objectives related to advocacy. 

• . p ^ ■ , 

In the Initiation Phase ^ \ ^ 

6) The project director's Ignorance of the mean- 
ing of child advocacy or its relevance for the 
project. 

7) Elimination of that part of the program design 
Which related to chlldVadvocacy (eliminating 
s'pecific advocacy training; eliminating specific 
objectives related to advocacy). 



8) Absence of any special training for advocacy 
staffs or any specified advocacy objectives. 



INDICIA OF DIFFICULTY AT. EACH ^PHASE (OR PROGNOSTICATORS 
OF PROBLEMS AT A FUTURE PHASET \ ^ 

In. the' Planning Phase ^ 

1) Planning not begun by individual init3^tive(s) . 

(For example, planning l^jggun in response to 
^ funding agency initiatives, sponsoring agency 
initiatives, or funding agency grants.) 

W .1 

t 

^ ^ 2) Need for child advocacy not widely recognized or 
accepted in the community. 

. 001G5 



158 



3) Project poorly designed. 

a) no clear diagnosis of need or problem. 

b) poorly selected target communlt^^ and 

target population. ^ 
cj no conceptual frajnevrork for the project. 
\ d) no clear Idea of what Is meant by child 

advocacy. 

4) Failure to Involve all facets of the relevant 
community In planning for the -project. 

5) (For new components of existing projects only) 
Failure to obtain administrative support for a 
new program. ^ 



In the Inltieftlon Phase " , 

6) Project poorly structured: 

a) Project director not Involved In planning 
project'. ^ 

b) No training for advocate staff (or only 
very brief training of one to two weeks). 

c) Failure to Involve all facets of the rele- 
vant commxmity. 

d) No further specification of objectives, 
ej No specification of advocacy targets. 

} f) No specification of strategies. 



7) Existence of numerous or extensive intra- 
organizational conflicts. 

a) Between director and board; director and 
staff; board and staff. 

b) Between pf*oJect (director and/or board) and 
auspice. 

c) Among staff. 

8) Inappropriate Selection of Targets 



a^ too rigid or too powerful. 
b| too widely dispersed. 
Er|c .• . ^ ^5 non-advocacy. ^, . | q g 
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9) Selection of strategies inappropriate to 
target. 

10) Staff without skills to achieve goals or imple- 
ment strategies. 

11) Use of Crash Programming approach. 
Absence of case or class advocacy. 

TABLE 



PRESENCE OF INDICIA OF DIFFICUL TY IN FIVE PROJEC TS 
DEFINED AS '"PAILUI?ES"* 



Projects - Indicia of Difficulty ** 



in Planning In Initiation 



B 


2,3,4 


6,7,8,9,10,12 




1,2,334 


6, 8, fo, 11, 12 


G 


2;^j^,5 


6, 8.9,10, l4 


T 




6,7,8,9,10,11,12 


W 




6,9,10,12 



The three projects alrdkdy identifieo^ as "non-child advocacy 
projects" (A,C,M) have/been eliminated from this analysis'. 
From this point on, discussion of indicators, criteria and 
evaluation points will be limite.d to valid child advocacy 
projects . 



ERIC 



* *Jlumbelrs refer to listing on preceding pkges, 
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TABLE 



PR ESENCE OF INDIC IA OF DIFFICULTY IN FIFTEEN PROJECTS 

r • OEPira AS NON-PATLtmES ^ — 



Projects 



Indicia of Difficulty 
In Plstnnlng Phase In Initiation Phase 



JET 






H 
Ik 






T 




o.y .10,11 




1.2,3 
J ^ ^ »^ 


6.8.10.11 12 


K 


1,2,3 


8.9.11 




1,2,334 


6,8,10.11.12 










4 


10 


p##« 






Q 


1,2 


6,7,10,11 










1,2,4 


6l7,8.io",il,l2 















♦ There are eleven Indicia of failure for new projects In the 
group and twelve Indicia of failure for new program com- 
ponents In old projects. 

♦* These projects show as many Indicia of difficulty as the 
"failure" group and are thus re -designated failures. See 
text. 

*** These eight appear to be the most "successful" projects 
and this becomes our hypothesis. 
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The first table above indicates the niimber of indicia 
of difficulty characteristic of the five child advocacy pro- 
jects tentatively defined as "failures." For new projects, 
the maximum number of such indicia in the planning phase 

. is four (and for new components of existing projects, five); 
for the initiation phase there are seven indicia of diffi- 
culty (applicable to both new projects and^new^omponents of 

. existing projects). The second table classifies -^y the pre- 
sence or absence of such indicia the fifteen projects ini- 
tially defined by default as "non-failures." Inspection leads 
to the tentative conclusion that the presence of three or more 

■ 'r 

indicia of difficulty in the planning phase reveals problems 
in that phase and also seems to be correlated with proble;ns 
in the initiation phase. In general, the presence cf five or 
more indicia of diffic\ilty in the initiation phase seems to 
<^ indicate "failure" in that phase, and preclude prograin imple- 
mentation. 

Employing experimentally the combid^d total of eight 
or mqre indicia as characterizing projects )which are "failures,' 
and three or less as characterizing "success"' we now add 
three projects frMi the original non-failure group and emerge 
with a group of eigk^ "failures" out of 6, total group of 
tv^nty (B,D,G,J,L,S,T,W), eight "successes" (E,l!',N,0,P,R,U,V) , 
with few or no indicia of difficulty and four "uncertain" 
, projects (H,I,K,Q). 
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AC TIVITIES CHARACTERISTIC OF THREE ADDITIONAL PROJECTS 
IDEHTTPiro AS "FAILURE" 



In reviewing the data in the table, three more 
projects (J,L,S) now emerge as apparent failures." One 
is a project that was beg\in at the initiation of the spon- 
soring \rjganizeLlp^ and is a revised version of an earlier 
component of th&t organization's program (the earlier pro- 
ject lost its funding) . TH^ proposal was prepared by a pro- 
fessioVial on the staVf^ of t3|ie sponsoring organization, some- 
one who was not involv^4 vSttl^sequently with the establishment 
of the project. : All of the staff were hired by the director 
of the auspice (although ha hfiid promised the elected com- . 
munity board of the earlier organization that it would 
function as the steering committee of the new project and 
have the right to do all hiring). The project director was 
not involved in the planning phase and was totally unfamiliar 
with the concept of child advocacy. All staff were hired 
within a few weelcs and were largely inexperienced. No train- 
ing was provided for them. The ^ograra was established by 
m^ans of "crash programming.'^ Targets and strategies were 
never specified and the project appears quite similar to any 
number of the coipiuniJ;y action programs of the sixties. 

It is or>e of the two projects to have an elected, 
policy-making board. However*, the sponsoring organization 
has never .permitted the^board to make policy nor is the pro- 
ject director given any real autonomy in making policy or in 
over-all pr,oJect administration. The young high school mem- 
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bers of the board never really participated on the board 
throughout the first year and the adult members found them- 
selves increasingly in conflict with both the project direc- 
tor and the sponsoring organization. After less than one 
year, the boarS'was dissolved and several months elapsed 
before a new one was reorganized • At the insistence of the 
funding agency, a new program component was added on to the 
project and the staff person responsible for it is respon- 
sible directly to the director of the sponsoring organization, 
not the^^^jroject director. A cla^ action suit, to obtain 
the elimination of the term "illegitiiftate" from birth certi- 
ficates, has been initiated at the instigation of the legal 
consultant to the project. However, it appears largely ir- 
relevant to a project purporting to be a youth advocacy pro- 
ject focused on legal rights of youth in relation to the 
school system and the Juvenile Justice system. Apart from 
this one case, neither case nor class advocacy has been imple- 
mented in almost one and one half years. 

The second of these three additional "failures" is a 
volunteer project designed to follow a model that has received 
enormous attention within the last few years. It Was begiin 
at the initiation of its sponsoriftg organization which wanted, 
to establish such a program as a pilot program. The organiza- 
tion instituted a study of the community to see if such a 
project v;as feasible. The final report of the study suggested 
that such a project might be successful but definitely not in 

00171 
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the community studied because it was hostile to the ppon- 
soring organization and to its presence in that community. 
Regardless of this recommendation, the organization went 
ahead ajid hired someone to write a proposal, submitted it, 
had it approved for funding, hired a director and established 
the project still in that scune commtinity. The director is 
young, inexperienced and unfamiliar with the comraiinity. The 
staff are young volunteers; they have been difficult to re- 
cruit €Lnd no training or supervision is provided them. Lo- 
cal agencies that are the sole source of referrals for the 
project have not been particularly cooperative since they 
did not want it in the first place and were not involved when 
the project was planned. The project provides a sort of 
"big brother" volunteer service for retardates and is in- 
creasingly moving into the provision of group recreational 
activities i Instances of case advocacy have occurred occa- 
sionally, by happenstance, it is not provided as a regular 
part of the prograun. 

The third project is one in which the leadership in 
the initiation phase is consonant with leadership in the 
planning phase and where various groups in the community were 
involved in planning the project. However, the target com- 
munity is rural and isolated with, a rather disparate and 
fragmented population. Only one other community organization 
exists there and this one was not involved in planning the 
project. Major problems in the community^ are poverty, un- 
employment and a complete lack of public transportation. 

0 0172 
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Health services are also inadequate and inaccessible. The 
, project is designed to implement a "systems model" approach 
to child advocacy whereby the community is supposed to iden- 
tify its own needs, priorities and methods of solution. No 
other objectives were specified initially or have been sub- 
sequently. It is essentially a community-based planning and 
coordination program and has devoted almost all of its effort 
toward the establishment of a day care project within the 
community. Although it has been successful in this, it has 
at no time provided either case or class advocacy in Its 
one and a half years of operation. It is physically situated 
within a local school system and q^onsored by the local board 
of education, and functions almost as something of an ex- 
tension of the school system. It does not see its role as 
one of internal advocacy, monitoring the school system in re- 
lation to children; it does not function in an extemflJ. advo- 
cacy role, acting as spokesman for the student in relation 
to other services and/or institutions; it does not even utilize 
its position in the school system to train teachers to act 
as advocates for their students. Although the director and 
assistant director are actively involved with various orgajiiza- 
tions in the community, advocate line staff - indigenous para- 
professional - have been underutilized throughout the life 
of the project. This is a known and acknowledged problem by 
both staff and administration, however, nothing has been done 
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about It,^ ^ 

In reviewing these three additional, "failures/* 
other tentative indicia of difficulty now may be identified, 



In the Planning Phase / 



- (Where a formal proposal is prepared and submitted 
to an outside funding source), preparation of such 
a proposal by a profesqiorlal proposal writer who is 
not an integral part of the planning and initiation 
phase. 



(Re -examination now discloses that all of the pro- 
jects in this study in which proposals were prepare 
in this manner are in the "failure" category.) 



In the Initiation Phase 

- New projects (as contrasted with components of 
existing programs) that are administered by the 

sponsoring organization with relatively little ad- 

" \ ■ 

» ministratiye autonomy in the hands of the project 
^ director. 

- Projects based within a system, that itself impinges 



^This project is one of the sixteen in the study that 
were case studies during the earlier research project as well^ 
Thus, it was visited on two occasions with an eight month gap 
between visits, ahd the same problems continued to exist. 

« r C 1 7 4 
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on children (e.g., school. Juvenile Justice) 
and t^t Is unclear as to Its role vis a vis 
the system (is It an internal advocacy project 
or external In relation to other systems?) 

- Under or Inappropriate utilization of staff, 

ACTIVITIES ' CHARACTERISTIC OF EIGHT PROJECTS IDENTIFIED 
■ ' ~ AS SUCCESSFUL ' 

^ As a group, the eight tentative "successes" appear 

far more homogeneous than the same sized group of "failures" 
described earlier. To paraphrase Tolstq|^ all successful 
projects are like one another; each uns,uccessf\il project is ^ 
unsuccessful in its own way. With regard to the planning 
phase, these projects (7) were begunj as a result of Indivi- 
dual initiatives ( one by a combination of individual and 
funding agpncy initiatives) ; and only one project was stimulated 
solely by the initiative of a funding agency. Seven included 
widespread community participation in the planning phase; 
only one did not have substantial consumer -Involvement at 
that time. In addition, five were aJLready able to be fairly 
specific about their objectives In this phase. 

In seven of the projects, the planners continued to 
be actively involved in initiating and operationalizing the 
projects. The one project where this was not the case is the 
only one in this group that is a nevi component of an ongoing 
program rather than an entirely new project. In this case 
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however, the top administrative staff were committed to the^ 
project from, its inception through its initiation, thus pro- 
viding continuity of leadership similar to the others. 

None of these projects employed "crash prograjmnlng" 
in the initiation phase. Four used "structured programming" 
and four, ''developmental." Either directly or indirectly, 
all the projects stress the importance of stfiff understanding 
the projects' objectives and their own roles. Six placed 

particularly heavy emphasis on training either through exten- 

i 

siVe training programs, repeated annual training, or a com- 
bination of both. The two projects that provided less staff 
training are the most "professional" projects - employing 
either professional staff or college graduates with extensive 
and related work experience. Even for this group, one pro- 
ject director stated in looking back at the project's develop- 
ment, more stress should have been placed on staff training 
and he anticipates doing so in t|ie second year of operation; 

Again, all of these projects concentrated on obtain- 
ing widespread community support as the projects were ini- 
tiated. Six have indigenous paid staff; three (including two 
of the former) have indigenous volunteer staff. Five of the 
^ six projects that have boards have community representatives 
(consumer, ^lay, influential, professional) board^embers 
and active, regularly meeting advisory or policy-making 
boards. Of the two projects that do pot have boards, one is 
attempting to form one ajid the othei* is part of another jjro- 
^ gram. All projects have been involved In frequent meetings 
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with consumers and lay people in the community as w611 as or- 
ganizational representatives. Pour are consciously struggling 
v/ith the problem of consumer accountability and are not sa- 
tisfied with current, approaches for achieving this. 

All eight are in the process of operationalizing 
their projects although only two are fxxlly operational. All 
have continued to refine their goals ajid have commented on 
the need for greater goal specificity. As a group, these have ^ 
the least dispersed targets. Three focus on ttie school sys- 
tem primarily; two on the Juvenile Justice system; one oh a 
single institution. ^Only two focus on multiple targets. 
Five projects (all less than two years old) hope to imple- 
ment class advocacy but are still unable to do so. For one, 
(a fxUly operational project) case and class advocacy are 
defined as equally important and receive equal attention in 
the project (although it appears to place greater stress on 
case advocacy), A second project, also fully operational, pro- 
vides some class advocacy but deliberately stesses case advo-V^ 
cacy. One project has decided that the two conflict and has 
opted for case advocacy. Two of the projects have existing 
replications already established; of these, one has eight 
such projects a^d the other is Just establishing two. One 
other project attempted' to do this bu^t was unsuccessful. 

Finally, four of the projects including the three 
oldest, stress the importance of organizing coalitions in the 
community tp ensure a large constituency and broader support 
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for specific issues J As a group, three projects are between 
two and two and a half years old; four aire one and a half 
years old. One was fifteen months old at the time of the 
study, however, it was modeled after ajiother project in 
this group that is one of the oldest in the sample. 



ACTIVIT IES CHARACTERISTIC OF POUR PROJECTS IDENTIPIED AS 
' "UNCEKTAIN" 



Finally, there are four remaining projects' defined 
as "uncertain" which by our criteria appear to be in poten- 
tial difficulty. A close look at this middle grpup may 
help identify other factors which may impede or enhance pro- 
ject implementation. 

Three of these projects are the youngest in the study, 
all less than one year old; thus their categorl>^ation as "un- 
certain" may reflect their youth. All are components of 
existing programs and all were begun as a resiilt of one fund- 
ing agency sing,ling these projects out to develop an advo- 
cacy component ajid awarding them' a special grant to plan ajid 
then to establish the project. None of the people involved 
in pletnning these projects had heard of child advocacy prior 
to notification by the agency that ^hey were selected to re- 
ceive t^s grajit. F,irst, all project directors 'had to learn 
what child advocacy meant or might mean; second, they had to 
overcome the resistance of tt^ir boards and staff to develop- 
ing a new program, when all fel^ more money was needed for 
the existing project. All the projects employed "crash pro- 
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gramming" in the initiation pha.ce. In one^ the over-all 
>^ director saw the need for having a lawyer on staff. Un- ' \ 

• able to pay a salary adequate to hire a lav/yer^ a third 

■ " if 

year law stfudent completing school at night v;as hired as 
advocate coordinator^ However/ he defines the community's 
problems as, primiarily, inadequ^ate information about exist- 
ing resources and a need for liaison, linkage^ or brokerage 
between consumers and services.. He sees no need for case 
v-^^ advocacy and thus has not implemen'^ed it. He.^sees no class - 
advocacy role, for the project because he does not believe" 
that the federal government should fund one organization to 
advocate against,, another . Thus, cl^ss jadvocacy has not been 
implemented. In general^ no advocacy targets and therefore 
no advocacy strategies have been Identified. The project is 
essentially an access service program, not an advoc^icy pro- 
ject as such. - ^ ^ ^ 

The second project is similar to the above but did 
begin provision of case advocacy in the course- of doing a ^ 
survey^ of the community. Initially, conflict arose because 
c&se advocacy was provided only for "new families" not those 
already being served by the project. This problem decreased 
when administrative concern arose about the limited number 
of families interviewf^d over a six month periodt and the ad- 
vocate coordinator decided to stop providing case advocacy 
and complete the survey identifying crommunity needs (even though 
many of these needq were urgent and required immediate atten- 
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tion). At the time this project was visited, ten months 
after it began. It appeared to be going backwards rather 
than' forwards.^ The project has no i^eclflc objective, 
target or strategies and the program seems to lack structure • 
and purpose. 

The third project In fhls group a^J^ears more likely 
to move towards Implementation, Planned and^ Initiated In 
the same manner as the other two, thts project has gone throvigh 
several difficult problems but seems to have coped with them 
successfully. The project had several organizational prob- 
lems during the first year which the director attributed to 
some of the limitations iapOepd by the funding agency and by 
the project's pollcy-ma^lngjBoard. He accepted those limitations 
resulting from board actions but found the pressures for crash 
prograunmlng from the funding agency created more dlfflcxilty. 
There was Inadequate time to hire staff, to train staff, to 
learn about existing resources, to specify targets and stra- 
tegies, to develop a program generally. As a resxilt, the 
InltlaDr coipmianlty survey was Inaccuratelyn performed' and mucH 
^ wo^k had to be redone. In an effort at Improving the program, 
a decision was made to eliminate part-time staff aftd staff 
supervision was reorganized. Regardless, conflict between 
the old project and the new. component continued for, some time; 

,— • ■• . V 

^ ' ^In the course of two ^additional visits and several 

other contac^^s during subsequent mfiJnths, a colleague working 
on a related study reac|ied' the sflune conclusion. 
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Throughout all of this however, the project has <; one ent rated 
on providing advocacy. Case advocacy is provided both to 
those families already served by the project and an addi- 
tional Gt*oup. It Is provided on an ongoing basis v^hlle 
staff carry out their survey of the conmunlty. In effect^ 
this survey Is expected to provide the case finding for class 
advocacy by the staff . Regular monthly records are kept of 
all needs that are Identified but cannot be adequately 
satisfied with existing resources or existing policies. At 
the same 'time the project was studied^ the administrator was 
preparing to analyze the dat^ on needs identified and docu- 
mented during the six month period of the survey and select 
those which were identified most frequently. In conJ\inction 
with the board members of the over-all projfeox^ priorities 
for class advocacy and strategies for implementation would 
be identified* 

r < 

The fpUjfEh project in this group has dqe of the 
largest budgets (over $200^000) and the largest staff (l8) of 
"•^the groups studied. It "appears to encompass a range of recre- 
ational^ tutoring and access services to achieve its objec- 
tive of delinquency prevention and youth participation in the 
planning and prograjnming of s9rvices related to^^hem. It 
spun off its coionseling services by obtaining an additional ^ 
grant and setting it up as a separate program. Lts- first an- 
nual progress report specifies -that the 'first year was focused 
on ^tructurin:^ the orc^anization and establishing the project. 



ooisi 



0 



174 



It has also had a large number of intra-organizational 
problems and in the course of one year, reduced its staff 
by ten, eliminating a group of ''street workers" and re-* 
organizing its program. It has also changed strategies 
from attempting to int^vene in systems., from the top in 
'order to effect change, to intervention at the bottom 
where youths first come in contact with these systems. 
Where most of the program is concerned, the project is 



•still feeling its v^. and it may be in difficulty^ However 
it has been unusually successful in implementing class 
advocacy. This has been done by a yoxing lawyer on the 
staff who has initiated several successful class action 
suits. ^ 

Among the suits involved are a right to treatment 
case against a local training school, and a due process case 
regarding the suspension from school of several high school 
students. (It may be worth noting here that of the projects 
that have been able to provide class advocacy, two have law- 
yers as .active members of policy-making boards. This may 
have some implications for the implementation of class advo- 
cacy generally at the commtinity level . 

In reviewing these four "wicertain" projects, two 
seem likely to Join the "failure" group while the other two 
appear to have^-aqre potential for implementation. It woiild 
seem that the primary characteristic distinguishing the lat- 
ter from the former is the regular and increasing provision 
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of advocacy as time goes on, a greater specificity of 
advocacy targets, and, in general," a clear concept of and 
concentration on the "mission" of the project, regardless 
of the occurrence of other problems along the v/ay. 
p Thus, utilizing asserabled/'case" data and pre- 

liminary Judgments about project' operations, the study 
has developed empirically a list of characteristics which 
may differentiate success ajnid failure in advocacy programs 
at each stage of development. The study now proceeds to 
incorporate these elements Into a first approximation of a 
phase-specific evaluation guide, (see appendix) and to re- 
port on its second phase. 
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CHAPTER VII 

A* FIRST ATTEMPT AT DIFFERENTIAL EVALUATION : THE FIELD TEST 

FIELD TEST METHODOLOGY AND DESIGN 

The last chapter described the process by which a 
tentative instrument for differential evaluation of communi- 
ty-based child advocacy projects was developed (see copy 
in the appendix). The three-part instrument - Classification 
of Child Advocacy Projects by Developmental Stages; Classi- 
fication of Projects by Advocacy or Non-Advocacy; Bating of 
Projects at Current Stage of Development - ia- in the form of a 
semi -structured interview guide, tt.was designed to be 
used by field representatives on site visits to projects. In 
short, it was designed with a view to use in a typical mon- 
itoring situation. 

This decision to identify with the task of the fed- * 
eral monitor may require some explanation. Our finding that 
project ope rationalization is a slow process, and that out- 

t evaluation is not feasible for several years, seems t6 
preclude formal research - certainly in the first two years. 
Yet, giy^n the stake in these undertaJcings , a mechanism to 
assure accountability is essential. The types of issuen 
which we have found relevant to assessment during plan- 
ning and initiation are obviously part of grant administration, 
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Since a major objective of thio second phase was to 
provide data for refining the instrument through test of its 
applicability and reliability, it seemed more appropriate to 
have Independent researchers make the field visits. The 
previous experience of this researcher with all the projects 
included in the sub-sample would have inevitably biased any 
test. On the other hand, testing the Instrument on projects 
outside of the study sample would have precluded even a 
primitive, preliminary test of Instrument reliability and 
validity.^ The decision, therefore, was to* employ three in- 
dependent researchers; provide a limited amount of training 
for them in the use of the instrument; have them use the 
instrument, and comment on its utility, facility of applica- 
tion, problems, and anything else of Interest and relevance. 
Descriptive data to Justify Judgements and conclusions and/or 
illustrate problems, were to be appended separately, by these 
field visitors, to the instrument for use in reviewing find- 
ings and to supplement the instrument. 

In brief, then, the objective of the field test was 
Ho learn the following: 

1) Could the instrument be readily used by researchers 
previously unfamiliar with the concept and practice 
of child advocacy? 

If not, what changes would facilitate its use? 

2) Would the project rating obtained from the instru- 
ment (data specified, conclusions of the field 
representative) be consistent with the conclusions 
drawn by this researcher during the first phase of 
the study (reliability check)? 
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If not, would it be possible to identify whether 
the discrepancies were a reflection of errors or 
gaps in the instrument, reality changes in the 
project over the six to eight month period of time 
since the last visit, an indication of inadeq\iacy 
Xn selection or training of the field representatives, 
or something else? 

3) What is the predictive capacity of the instruqient? 
(e.g., if a project has been rated a failure in 
the planning or initiation phase as of the initial 
visit, has it progressed to a later phase or not? 
If it has, is it still rated the seune way, even in . 
the next phase?) 

For projects in the implementatitin phase, opuld one 
begin to identify possible outcome measures?' (As 
noted, impact measures were not relevant to "the 
projects in earlier phases.) 



As indicated in Chapter III, the second phase of this 
study was initially planned to include a field test of the 
instrument by this researcher, in a selected sub-sample of 
six child advocacy projects. It was also anticipated that 
the instrument would include criteria for outcome evaluation. ' 
As has been indicated, this proved unfeasible. This facet of 
the study findings will be discussed fxirther in the concluding 
chapter. 



Sample Size and Composition 



The sub-sample of six projects was initially planned 
to include two projects rated "successful" and classified in 
the implementation phase as of December, 1972; two projects 
that had been rated "uncertain" and two rated "failure" or 
"unsuccessful," the latter four all in the initiation phase. 
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It was decided that clnce the sajnple was limited, none of 
the clearly "non-advocacy" projects would be included since 
little more could be learned from these to improve the in- 
strament. Furthermore, in an effort at tapping more sub- 
tle distinctions between and amon;? projects, neither the 
most obvious failures nor the mast obvioua successes would 
be included. ^ 

Although no project approached refused access, there 
was some difficulty in scheduling visits to fit in with the 
time limitations of this study and the availability of the 
fiqld representatives, on the one hand, and the time con- 
straints of the projects visited, on the other (e.g., scheduled 
visits of project monitors, other evaluation teams and/or y 
researchers, potential funders; conference and speaking en-i \ 
gagements of project staff). Thus, the final sample selected 
included two "successes," one "uncertain," and three "fail- 
ures." These projects represent different geographic loca- 
tions (West, South, and East); urban and rur9.1 projects; dif- 
ferent funding sources (public and voluntary); different 
auspices (public, voluntary, autonomous, component part); dif- 
ferent staffing patterns (paid, volunteer, professional, para- 
professional); different ethnic compositions of staff and 
garget population (white, black, mixed); different types of 
advocacy (case, class, mixed); different targets (single and 
multiple); different entry points (case and service system); 
and different structures (formal, informal). ' 
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Data Collection 

In each case, arrangements for access were made in- 
formally, over the telephone, and confirmed in writing sub- 
sequently.. 

Three doctoral students at Columbia University 
School of Social Work were employed for purposes of the 
field test. Thfey received the equivalent of one f\ill day 
of training and were given the final report of the previous 
study, Child Advocacy , and Chapter IV and V of this study to 
read for general background. In addition, limited factual 
material - proposals, publicity releases, information dis- 
tributed by the project - was also provided for specific 
project back^ound, as well as one copy of the instrument 
to review and raise questions about in. advance. In short, 
an effort was made to approximate the monitoring situation 
in a federal agency. 

A memorandum, with instructions for the site visits 
(a copy of ^ich is also included in the appendix) also was 
provided. Each field representa^tive was to visit two pro- 
jects, for approximately two and one-half days each. Two 
completed both their vi3its in one week; the third, because 
of problems in scheduling the visits, had a one week hiatus 
between the two visits. All visiting w&s completed between 
May 4 and May 22, 1973. In each case, in addition to formal 
completion of the instriament for each project, a supplemen- 
tary narrative nummary was either dictated or written, and 
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one-half da^was devoted to subsequent "debriefing." These 
visits wei^idefined to intem^iev/ees as designed to provide 
an opportuimty to refine the instrument; to learn more about 
evaluation; l^d^^ learn more about child advocacy projects 
generally. All projects and staff were assured of complete 
confidentiality; all were, informed that identifying informa- 
tion about the projects would be' delet^Qd. ^ 

In each , field test, because of thfi^-eorrs^Miints of 
time, it was agreed that the principal investigator or pro- 
ject director would arrange and schedule the' interviews. It 
was understood that such selective screening might bias the 
results but was felt that "who" is interviewed should reflect 
the administration's most positive image of itself - a rea- 
sonable starting point. Some allowance shoxild be made for 
this in the analysis, however. 

Finally, although the field representatives knew that 
the projects visited included some rated successful, some 
rated \insuccessful and some rated uncertaini meticulous care 
was taken to avoid any trace of evaluative comments in the 
pre-field test period. In this regard, the visits were "blind." 

What follows in the remainder of this chapter is a 
summary of the findings and conclusions of this first field 
-test. 

FINDINGS AND CONCLUSIONS 
Instrument Usability 
^ The first purpose of the field test was to see whether 
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the instrument developed could be used readily by researchers 
previously unfamiliar with the concept and practice of child 
advocacy. The assumption was that if there were problems with 
the instrument^ these would be Identified in the field test > 
and corrected before attempting or suggesting more e^Ctensive 
use • 

In general^ the field investigators found that the 
interview guide was too unstructured for easy use. Because 
of their limited knowledge of child advocacy^ extensive note tak 
ing during the interviews and extensive time for summary emd 
analysis were required before the instrument itself could be 
filled in. Although some of the information gathered was 
helpful in providing supplementary information about child ad- 
vocacy projects generally^ application of this instrument on 
a larger scale would be facilitated by the development of a 
more structured questionnaire. Increased investment in train- 
ing is an alternative but may not assure as high a degree of 
reliability over time as new personnel enter the process. 

^ Initially^ the selection of the particular format em- 
ployed^ was guided by the prevailing pattern in federal agen- 
cies. Project monitors use interview guides when reviewing 
federal projects ^ while researchers tend to use structured 
questionnaires for formal evaluation purposes. Considering 
the fact that only one of the field investigators was a re- 
searcher^ and that all had extensive practice experience in 
social agencies of various types ^ their suggestion for further 
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^ structuring of the inGtra-nent ■w6uld seem to have merit^.r. 

In addition to facilitatti^g itistraiient use, employing 
a structured questionnaire liJnit^ Interviewer Ibiaa One 
problem that arose in the field t^st; was the different per- 
spective each interviewer brought to the interviews. For 
exajnple, one field investigator was far more fajniliar with 
community organizing activities and practice than the others, 
while a second represented a traditional casework orientation 
towards social practice. The result was that the former had 
much higher (and clearer) expectations regarding advocacy 
activities, v/hile the latter tended to equate all "good case- 
v/ork" with case advocacy, (Although "good casework" should 
include case advocacy when appropriate, the two are not syn- 
onymous. Counseling or providing escojrt services may be 
part of good casework practice, b^u^^9 not advocacy. There 
is a valid distinction between thi^^^>iQr.) 

The different perspectives showed up more in their 
respective narrative summaries than in the instrument itself. 
However, there were some istpparent variations in filling in' 
the instrument, with regard to the types of jictivities des- 



"^In fact, based on this experience, a- more structiired 
Instrument (with some open ended questions requiring proibing 
by the interviewer) actually was developed In a parallel re- 
search effort when the staff of this project was asked by OCD 
to develop an, instrument for the classification and rating of 
operational status of child advocacy projects generally in 
connection with HE\V program strategies. This questionnaire,, 
derived from the interview guide/Used here, illustrates what 
v/ould be the next stage in instrtijnent development for evalu- 
ating child advocacy projects. Several illustrative items 
are provided in the appendix. 
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crlbed as "advocacy.'* A structured questionnaire would limit 
these variations as well as minimizing variations in Inter- 
viewer ^styles , thus ensuring greater reliability of responses. 
Since the nature of the advocacy activities xindertaken by 
the project and its 'staff is so crucial for both classifica- 
tion and evaluation purposes, accurate reporting becomes par- 
ticularly iinportant. 

Related to this, certain concepts and terms used in 
the Instrument shoxild be much more clearly egid 'precisely de- 
fined within the instrument itself - in particular, case and 
class advocacy* - to assure accurate and reliable responses 
by interviewees. Again, this is natural under a structufed - . 
format and was incorporated into the instrument developed 
for the related project (see footnote. on,< preceding page). 

In the instrument used for the field test, projects 
were rated only at their current stage of ^development. Sub- 
sequently investigators were requested to rate the projects 
at at laast one earlier stage, from the data they had included 
in their narrative siommaries. Another suggested change 
fou/id necessary is that although projects should be rated by 
their current stage of development, as of the field visit, 
the instiniment should incorporate all stages^ and final rat- 
ings for each project should be both phase-specific as well 
as cumulative. ^ Following this procedure, projects classified 
as in the planning stage would be rated for planning only; 
projects at the initiation stage would be rated for planning 
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and initiation; projects at .the Implementation stage W9uld 
be rated for all three stages . In this way, evaluation 
of an imple;ncnbe(* project v/ould reveal ,its rating at each 
stage, permitting comparison with other projects at an ear- 
lier stage of development, as well as indicatiExg whether its 
owj^pattem of development seemed coiisistent with its 
earlier development. This approach employed in a large n\am- 
ber of projects might also- help ♦ identify additlond.1 variables 
that might account for differences in subsequent stages. 

Finally, in scheduling interviews folr site visits, it 
now seems essential that the evaluator structure the border 
^ of interviews in advance,* rather than permitti^i^ the project 
director to do so. For the. purpose of the field test, pro*- 

tct directors were permitted to schedule interviews at their 
nvenience, as they saw fit. The results were unfortunate 
li^ several instances. For example, three directors scheduled 
initial interviews with clients, other agency representatives 
or board members, and arrajiged for administrators and staff 
to be interviewed only towards the end of the visit., For 
interviewers to obtain information in logical sequence, plan- 
ners and administrators should be interviewed first so as to 
obtain a basic picture of th^ project. Staff shJi^d be inter- 
viewed next, for their perspective on their own roles, as 
well as to provide supplementary validating data about the 
project generally. Then board members, relevant experts or 
consultants should be seen. Consumers slliould be interviewed 
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only after the interviewer has a firm grasp of what the pro- 
ject thinks it is doin^, or trying to dp. At the end of the*^ 
process representatives of target agencies should be inter- 
viewed 'to round out t|ie picture eind to provide data frorti an 
outside point of view. Some time at the end of the visit 
should be allotted to re-interviifewing plauiners euid direcjtors 
for follow-up, filling in gapfe, or 'resolving possible con- 
fusion and differences. This ordering of interviews ensures 
that the interviewers will obtain a picture of what the over- 
all project looks like, and what it is doing befcire they ob- 
tain more specialized data that support - or conflict \iith - 
the general description and lead to evaluative Judgements. 

Instnoment Reliability and Project Changes Over Time 

The second purpose of the field test was to provide 

-f • 

a reliability check on project classifications ajid ratings 
completed by this researcher in the first phase of the study. 
The instrument employed in the test was derived from data ob- 
tained in field visits made between October and midrDecember , 
1972, while the instrument itself was developed during the 
following three -months and applied retrospectively to the 
projects. The field test itself ^occVirred approximately six 
months after these initial visits, in May, 1973. A more 
. valid test of reliability would have bee.n made if the inde- 
pendent investigators had gone into the field at the same 
time as this researcher, however the process by which the in- 
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strmient v;as developed made such an approach impossible. Re- 
cognizins the potential pr^lem^ resulting, from such a /gap 
^ between the time v;hen. the original data^\!>ere obtained and when 

th? field test was made^ it' still seemed worthwhile and ap- 
proprl^te to try to compare the 'findings of the field test with 
the Initial findings and ratings of the six projects involved^ 
to se^ if there" was consistency.^ Vfhere inconsistencies ^p- 
peared^ some consideration ♦ would be given to discovering whe- 
. ther they might be attributable to the hiatus between the tWo 
visits^ -or whether they reflected errors or' inadequacies in 
the instrument itself. 

A3 mentioned earlier, the projects selected for the 
test included two labelled '^successful/' ^ one "uncertain^" 
and three "failures." In addition^ the first two of these 
\7ere in the implementation phase and the remaining four in 
the initiation phase. With regard to the* classification of 
projects into developmental phases^ four wer^ classified in 
the same -stage by both the field test and this researcher 
(the tv/o successful .projects and two of the failures); One 
of the failure group ^ and the one labeled xincertain were re- 
classified as just beginning the implementation phase (ad- 
vocacy activities nqw being provided regularly). In.bdth of 
these projects, the passage of. time appears to have made a 
substantial difference and to explain the discrepancy. For 
the former, one of the youngest project's - less than one year 
'Old at the time studied - oiae would expect a six month passage 
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of time to reveal changes, since developmental stages are 
in part, time-- related. For the second project, however, 
although the passage of time may have made a, difference , what 
seems more importajit, is that a major change in programming 
occurred, leading to its reclassification into the impleipen- 
tation phase. This second' project was planned and initiated 
as a case advocacy project, this facet of. the program has 
still not been -implemented. However , during the initiation 
period, project goals and strategies Were redefined and the 
program redesigned to enqphasize class 'advocacy. It now 
appears to be implementing its ffrst class- advocacy activities 
and is no longer attempting provision of case advocacy. How 
the instrument could be redesigned to 'tap such potential for 
change, and whether or not this changed program can be sus- 
tained ai>d be effective, reqiAres further study. 

With regard to project rating, once again ^ the findings 
are mixed. In general, failures seem^ to.be more reliably 
evaluated as failure, on an item by item basis, than successes, 
Ratings for all. three unsuccessful projects^ were the same on 
every item both initially and for the field test, for the ini- 
tiation phase. However, one project in this group was re- ^ 
classified auid thus also rated in the implementation phase. 
,One problem in evaluating projects is highli^ted here because 
' * the project (described' above) changed from a case to a class 
advocacy focus, and redefined its goals in the process. If 
project rating and evaluation generally are concerned with the 
extent to which a project achieves its initia^y specified 
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^goals^ this projec>t would still be rated as a failure^ On 
the other handj, if evaluatio^a addfre.sse;^ implementation of. 
"advocacy" and accepts changed goals that are el^fectively 
achieved, this project would currently be rated ^^uncertain." 
Perhaps the most interesting question here is why the pro- 
gram changed and v/hether this potential for change could ^ 
have been identified earlier.' According the principal 
investigator and the* pro ject director, after one and one- 
half years in operation they realized that 1;he project goals 
(case advocacy in a local elementary school, provided by 
speAallzed, indigehous paraprofessional aides; class advo- 
' cacy, to evolve from documentation of ca*se findings) could 

not be achieved' by the'existing project structure (aides 
working within the classrooms as liaison between parents 
and school). The school was too powerful and intransigent; 
the aides had too little training, knowledge and expertise; 
the^ school administration and etaff were unresponsive; the 
project ahd its leadership did not have enough political 
clout.)*' The- project directors decided instead to use the 
aides to organizie groups of parents around specif ic issues 
(introducing ethnic material into the school curricula; get- 
ting the teaqhter of a particular class changed; adding a spa- 
' cific extra-curricula program) and to train the par-fents'to 
act' as' advocates for themselves and their children. Thei,r 
feeling was that organized parent groups, working in their 
ovm- self-interest, ml^ht be more effectiye in the school than 
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outside project staff. At present, after ^Ix months- of 
work, these groups have been orgflinized, have selected spe- 
cific, limited issues ibo adcfress, euid have begun to effect 
certain changes. The problem that remainiB is that the aides 
still feel they have insufficient . skills to organize and 
train the parents and the project has been unable to obtain 
the support of tJife existing Parent-Teachers Association and 
•thu6 expand its own power base.. Of some interest in this 
recent developnjent is that \inlike the original program, it 
was planned auid initiated by the project director working 
with staff and a local comjpunity group (the project director 
was not involved in planning fo;^ the Initial program). Whe- 
ther or hot it can succeed remains to be seen, however, this 
project has made a definite change since the earlier visit, 
and the potential for change was not revealed in the earlier 
rating. , , 

The project classified initially as "initiation phase,, 
rating "uncertain,'^ i^ now classified as. beginning Implemen- 
tation, "uncertain." Its rating for the initiation phaae is 
the same , in both -the field test and the phasing-in study. 
However, it has recently expanded its training program for 
staff (now given four times a year for one week each time) and 
is providing case advocacy regularly. (My concern with this 

■^^he Uhited Bronx Parents Organization began in 
New York City on a similar basis, although the idea was 
generated by the parents themselves. It has-been increasing- 
ly successi'vl since its ^nception, seven years ago. 

. / , 
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project Is that one of the consumers interviewed by the 
field representative v/as the same as one interviewed ear- 
lier by this researcher, and the otfter had been extensively 
descritjed to me at that time. After a seven month hiatus, one 

•would, expect different clients to be presented.' Perhaps 
this tendency to display "tra^ined clients" shoxLLd be in- 
corporated as a criterionF). ^ ^ - * 
It is with regard to the successful projects that the . 
greatest discrepancies appeared betwjpen the Initial ratings 
and the field visit evaluations. One project that^ had been 
impletoenting both case and class advocacjr had hot been in- 
volved in any class advocacy for the paSt four months when 
revisited. Its recently recruited volunteer staff had re-' ^ 
'ceived no training for their advocacy rples. It is rated on 
the gttide as never ha'^lng been replicated elsewhere. (T^e 
interviewer was told this by the prc^ject director although 

seven other community -based projects consider themselves to 

• . 

have been designed on the model of this projectl ) Finally, 
consumer and board input into the proJt^ct is now identified 
ag negligible, although it had earlier been rated as )iigh. 

Are these discrepancies an indication of the unffe- 
liability of the Instrument or has the project actually dhanged? 
If the latter, what caused the change? In exploring these ^ 
discrepancies between the initial rating and the current one,- 
it was discovered that the project director had resigned 
five months earlier, and the assistant director three months^ 
before the field visit. Although the current director had been • 
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a staff member from the project's Incejftlon, he had only comi^- 
to' the xomnamity at that time, Ih tonttast to the two atoln- 
Istratbrs who had been born ajid broi^t up In the community. 
The new director was totall;^unfamli^ the project's, 

origins and over-all administration, uncliear about the pro- ■ 
Ject's current' funding, could not locate a copy of the original 
project description or a copy of a proposal recently approved 
for federal funding. No board meeting had been held for four 
months and no staff tralnl.ng. .Interviews with target ag.ijicy 
representatives revealed a sharp decease Iji contacts artd the 
comraunity groups^^p^evlously working with the project are no 
longer Ir? contact wltih It. From this limited" data, it wo\ild 
appear that 1^he change in the project leadership was follow^ 
by a rapid •decline of the pi^oject. Furthermore, elections 
held in November, 1972 resulted in substantial changes on the 
local school board and other local offices, conservative 
political group is now dominant in the communis and the aul*- 
rent director is f)^a>ful of antagonizing local goyemment of-^^ 
ficlals. He 'has instructed staff to eliminate class advo- 
cacy activities. The praject is now concentrating on direct 
'services limited case advocacy. Needless to say the pro- 
ject is rated currently as "unsuccessful," in the tmplementa- 
tion phlise, with an explicit comment by the field investigator 
that, "This project, appears to have gone downhill shairply 
within the last^ew months , according €o both staff, cooperating 
and targeto^ agency representatives/ 
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Tl\e sixth project, and the' second' rated "successful"" 
initially, is classified as implemented, but rated also as 
far less successful than previously. Again, its ratings for 
the initiation phase are the same as earlier while its ratings 
for implementation p hase have changed sharply. For ex- 



-ample, as part of the validating data suppor^ng the 'item 
stating that case advocacy is provided regulatjy (one, case 
advocacy action per>week per Cull-time staff member) this- 
project documented 238 cases -y^f^th multiple advocacy activl^ 
ties - for the period of January 1, 1972 - December 3I3 1972 
fiind only 28 cases between January 1, and May, 1973. In ex- 
plaining this^ decline in case advocacy, the principal inves- 



tl^ator informed the intervi^er t 



tlgator informed the intervi^er that he had been notified 
that because of cutbacks In f^eral funding for social programs, 
federal funding would -end in the coming year (the project's 
third year of operatiori), even* though the project was cOnsi- 
dered to have been effective. He had managed to obtain assur- 
ance from a state mental health' agency that fundus could be 
obtained to continue the project if Its focus were shifted to 
an emphasis on "mental health.^' The project's- goals and 
strategies. are curreritly being redefined to meejt new ^Ide- 
lines and the project is now emphasizing counseling and direct 
services. - t 



Earlier Ratings' Predictive Validity 

ImpllScit in what has been said'^in the previous section, 
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early ratlVigs of failure appear to be predictive of failure 
In later stages while successful ratings In an early phase 
have only partial validity In predicting success. Those 
projects vrtilch moved from ^he Initiation phase to the 
Implementation phase and had been rated as unsuccessful, in 
the earlier phase, continue to be rated as either unsuccess- 
ful or, at best, uncertain. In the later phase. The two 
projects that were rated as successful* In t^e Initiation 



phase, by bqth. th6 field Investigators and this researcher, 4 
and had been Initially r^ted. succ^sful. In the implementation 
^ phase, were subsequently rated uncertain or failure in the 

field test. Al^ough t^e issue may be one of Instrumertb 

r 

reliability, the findings seem to indicate that the changed 
rating is attributable to variations in the project that 
occurred during the six months between the two visits, for 
reasons mentioned earlier. 1 

Thus the predictive capacity of early ratings appears 
analogous^ to the situation regarding the reliability of the 
instrument: Are th^ ratings valid only for predicting fail- 
ure? Is the instrument reliable only where tinsuccessful pro- 
jects are concerned? Or is the instrument itself both un- 
reliable^ generally and invalid for predicting anything about 

/ a project^ Perhaps the only reason consistent c(^Qlusions are 
reached about project failure is that the probability of fail- 

^ ure is so great that any casual assumption of failure has a 
high probability of accuracy, regardless of the basis for 
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the conclusion. One other posGib;Le reason for this dlfficul- 
ty In Identifying^ or predicting successful advocacy pro- 
Jects Is that advocacy projects^by their very nature may 
^^yt)e so ephemeral that the likelihood of a successful project^- 
remaining successfiil Is very cllm. . Finally, as is pointed 
out by two v/ell -known theorlJ5,ts of organizational change - 
and confirmed by the findings In this study - failure In 

the early stages of project' development may well preclude sue- 

'I] 

cess In later stages; however, success In the. early stagfes 
does not ensure success In' a later stage. The problem may 
well be that the phenomenon Is too young, and we still haVe 
not Identified enough successful projects to provide precise 
data regarding 'what variables are critical in determining 
success. Unsuccessful projects are legion and we can, 

r 

and should learn from thorn. 

For whatever reasons, the Instrament does not seem 
able to identify or predict sustained success in child advo- 
cacy pro ji^ct 8 ,al though it does seem able to identify and pre- 
dict failura and potential failure. Why this is the case can 
only be answered by further study. To some extent, the capa7 
city to^ screen obvious failures early in life may per- 
mit easier identification of potential - or transitory - 
successes. More inteijirsive study of this category may even- 
tually clarify what a successful project really is, whether 
its success can be sustained for any period of time and what 
variables mijht accoxint for such success." 
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Additional Emergent Variables 

In analyzing the data obtained from the field test - 
in particular^ the narrative summaries provided by the field 
investigators - ce]f^ain additional "Variables emerged, whose 
presence would seem to be positively correlated with success* 
and v^ose absence seems positively correlated with failure. 
The first variable so identified, is. the importance of staff 
supervision. Among the most important indicia of difficulty 
in projefct development is failure to provide adequate train- 
ing for advocacy staff. Further study of this sub-sfiunple of 
six" projects , seems to indicate that not only is training 
ol\ enormous importance, but competent, ongoing and regular 
supervision is on additional essential. Prom discussion with 
staff of several projects, it would^appear that 'the content 
of training programs may be lost unless staff have opportunity 
to apply their new learning in practice as well as 
clarify problems €uid verify substance with a competent super- 
visor. In general, group supervision seems preferred by 
most paraprofessionals, as being least threatening and most^^ 
helpful in terms of providing an opportionity to share in the 
e^erience of peers as well ap to obtain additional expertise 
and skills from someone more experienced. Where training 
programs exist without adequate subsequent supervision, staff 
tend to view the training as "schooling'' and the subsequent 
practice as ''work,'* and find it difficult to integrate the 
two. 
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Second, efforts at seXI evaluation we're' Identified 
earlier as being; characteristic of the Implementation phase 
" of project developjnent • In reviewing and analyzing evalua- . 
tlon reports of projects, prepared either by Internal or 
external staff, a further criterion --or qualifying va3;iable - 
appears to be an essential facet of ^uccessTul implementation** 
Almost all the evaluatiW reports prepared by projects includ- 
V ed in the over-all, study (three in the sub-sample; ,^ctnn in 
/the larger sainple) utilize measures of effectiveness such 
' as -increased reading scores and higher school grades .when ' 
; . evaluating the achievements of projects. ^ Thus far, only one . 
prfifjfect has tried to employ measures specifically relat©4 to 
advoca-cy. It' would seem therefore, that in seeking put suc- 
cessfully implemented child advocacy projects we might look 
for projects which incorporate such advoc€ipy-st)^cific mea- 
^sttres'into their own efforts at assessing project accomplish- 
P ments. Certainly, it , seems reasonable to expect a project 

stressing advocacy to evaluate its achievement in that con- ^ 
text, and not in other, less relevant terms. 

✓Finally, in <^r search ^f or successfully implemented 
projects, one other criterion seems a likely candidate for 
indicating success, although thus far nb project reveals it. 
In a .sense, this characteristic (or variable) might Indicate 
the presence of a fourth phase of project development, one 
which was initially hypothesized but then eliminated because 
-no project in the current study revealed its presence. This 
variable might. be defined as "stabilityj" as a separate phas^ 
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It might be termed "contlnvlty" as vrtais mentioned In Chap- 
ter V, or "routlnlzatlon" as defined, by Hage and Aiken. ^ 
This phase Is described In the literature as characterized 
by the stabilization of a project or pfogreimj its presence 
Is demonstrated when the initial project leadership leaves ' ■ 
and the project continues with its mission under new and 
'different leadership. Close study of child advocacy pro- 
jects has revealed how crucial the factor of project leader- 
ship 18\ We have seen repeatedly,- how apparently successful 
projects decline when directors leave. Perhaps an inqportant 
indicator of a successful and fully Implemented project is 
its capacity for continuity even when its leadership changes. 
However, as mentioned earlier, this may be only a theoretl- 
»cal possibility. In real life, loss of leadership may in- 
evltably mean loss of direction for social programs. Rou- 
tlnlzatlon may be true only for other types of » organizations, 
• , or only in theory, and stability may continue to elude child 
advod^icy projects. Clearly, this has been the case for proy^ 
Jects in this sample. Unfortunately, it seems, equally ob- 
vious that without some stability successful projects cannot 
maintain th^lr success. An Intermediate apprdach might be, 
therefore, to Include as a criterion for successful Implementa- 
tion the continuation of project mission for at least six 
✓ 

months \inder new leadership. \ 

Although thl^^-i^not an emergent Variable, one other 
problem em!erged which the Instrument was not able to handle;, 
and that is the absence of any criterion that can incorporate 
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or make allowance for a^. complete change in the nature of a 
program suc^ as project that changed from a case to a 
class advocacy focus. Is there some kind of instrument that 
will permit evaluation when project goals change completely? 
Or ife it possible merely to indicate that a project failed 
to achieve initially defined goals, but then was reorganized, 
and , redefined j\ts goals? What is the likelihood of^such 
change bding effectively implemented? Is it v/orthwhile sup- 
porting a prqject that seems to be developing unsuccessfully 
for two years, and thei^ continue to support it in another 
guise? Perhaps here, what is needed is a cut-off point* For 
example, if a project does not implement its 'initial program 
by the end of the second year, and wants to change its focus, 
the whole plan for c)^ange should be subject to re -evaluation 
almost as if it were proposed anew. The problem of goal 
change and reorganization of a project suggests another area 
for fur their study. 

While' this chapter has reported" on the findings of 
the field test of the instrument, the narrative siimmarles 
^ completed by the field investigators provide furthef^nsights 
into child advocapy projects, programs and practice, generally \ 
supplementirt^ refining, or confirming impressions obtained 
by this researcher in the first phase of the study. Some dis- 
cussion of this material will be included In the next chapter. 
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This study has been focused essentially on metho- 
dological issues and questions ^regarding the evaluation of 
child advocacy projects. In this chapter, I have tried 
to employ the findings ajid observations of the current 
study to evaluate the method employed - mail survey and 
semi-structur#d case studies - in the eabrlier baseline study 
and to derive some new and additional insights into the na- 
ture of child advocacy. What follows, therefore, is quite 
consciously outside of the original and basic .design of 
the study; however, the material^ included evolved inevitab- " 
ly out of the unique opportunity provided for revisiting 
a large group' of child advocacy projects (sljtteen of the 
twenty-three had been visited one or more times previously) , 
and for reviewing, rjef inlng and revising some of the ideas 
about the programs cmd practice expressed in the earlier, 
1971-72 survey. 

CRITIQUE OF THE METHOD EMPLOYED IN THE BASELINE STUDY ^ 

The most obvious fault of the 1971-72 study was the 
reliance on a mail survey^ of progr^uns and practice. Data so 
assembled, have limited reliability and validity. This limlta- 
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tlon became apparent v/hen the first case studies v/e re com- 
pleted in late I971 and was further confirmed by the ex- 
periences of the current study. For example, the three 
projects inappropriately labeled child advocacy initially 
responded to the questionnaire by stating that they were 
indeed ".child advocacy projects.""^ Ye.t, when visited this 
year, they immediately ackriowledged the inappropriateness 
of the label. In almost every case, a mail questionnaire ^ 
elicited idealized responses combining intent, and antici- 
patiqn, and representing a kind of "wishful thinldng." 
The 1972-73 study confirmed the existence of an enormous 
gap between rhetoric (the questionnaire responses)- and 
practice .(what really went on in the projects). Some of 
these responses were deliberately inappropriate, in part 
because project directors defined the study as influencing 
the continuation of their funding. In other cases, the 
errors in response were the result of honest ignorance and 
confusion. Inevitably^ a questionnaire developed to elicit 
responses in an unkno^vn domain reflected some of our own 
initial lack of conceptual clarity and thus con-Jjributed to 
some of the problems of respondents. This may h6.ve been 
unavoidable since one function of .the questionnaire was to* 
help clarify the concept and to delineate p^ii^ameters . 

^ Ma^l questionnaires require *a particularly high de- 
gree of precision in language and a clear definition of terms 
and concepts. This becomes particularly difficult in a dif- 
fuse domain. To illustrate some of the confusion of respon- 
^See Chapter VI for some discussion of these projects. 
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dents, one question asked was whether an organization was 
supp orated -by public or voluntary funds. If their auspice 
or sponsorship was voluntary, even though the project was 
totally supported by public funding, project directors some- 
times indicated that they were "voltmtary organizations" 
and financed through voluntary fianding. Confusion was 
reunpeuit also i^ the responses to how "professional" and 
"paraprofeasional" staff were distinguished and what was 
meant by "accountability" or responsiveness to consumers. 
Direct J^nterviews have the enormous advantage of permitting 
probing and exploration when it is apparent - that the inter- 
viewee ha^ misunderstood the question or there is sane un- 
anticipated language im|)recision. 

Even though the mail questionnaire had been pre- 
tested, many of these "bugs" were sULl not eliminated. Con- 
fusion about the use of^ terms and language in a questionnaire 
is even more likely to^occur where professional, regional 
or cultural differences exist in the group surveyed. Thus, 
a national survey cutting across interdisciplinary practice 
.was subject to even more difficulty as a result. Recogniz- 
ing that the problem of interviewer bias is more likely to 
occur in direct interviews, it still seems a preferable risk 
for purposes of describing and analyzing actual programs and 
practice. As indicated in the last chapter, a structured 
questionnaire may limit some potential bias. 

Finally, another limitation inherent in the method 
of ^he earlier study relates to^our earlier ignorance about 
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the lire history of child advocacy projects. We n-;ere not 
aware of the sta^^en and phases inYproJect development and 
aoGumed these projects woiild^be much further along opsra*- 
tionally . than they were in fact, Searching for what could 
be defined as child- advocacy practice^ v/e tended to identi- 
fy with new project directors and assumed that what' was 
planned would eventually be implemented. In retrospect^ 
we now kr)on^ that in surveying newly established projects^ 
it is particularly important to make several visits evert if 
they are brief, with a gap of six or more ^months l)etween 
them. Older organizations, especially if they are small- 
scale, can be studied more exteYisively in one visit because 
their operations are readily visible and their routines more 
fixed. New ones require at least two visits over a period 
of time to see if there is any actual implementatljon of what 
was initially projected. Personal observation of staff 
and program in action i^undoubtedly the best way to knovt 
what is really going dn in{|a project. / ( 
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The Role of the Funding Agency; Conflicting Guidelines 
and Directives 

As mentioned earlier in Chapter VI, tjie availability 
of funding is the single most important factor in stimulat- 
ing the development of new projects and influencing their 
over-all '^look,*' This finding confirms our earlier impres- 
sion (see monograph) ,that ''money" appeared to be the most 
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important factor in determining goals , bases of operation 

and even orgajiizational structure. Since seventeen of 

these projects are fvinded by federal sources, federal agency 

guidelines assume enormous inqportance. The inherent con- 

filflGts, both explicit and implicit, in some of these guide- 
s' , 

lines, and the problems, difficulties and resentments that 
emerged in child advocacy projects as a result became 
readily apparent as these projects received closer scrutiny. 
For e3tample> without ajiy clear idea of what child advocacy 
' meant conceptxxally or in practice, several federal agencies 
' announced their intention to f\ind community-based child 
advocacy projects. Indicating their interest in fvinding 
demonstration projects reflecting a variety of models, of 
child advocacy, several proposals (even among the gro\i^ 
. funded subsequently) were turned down because their design 
did not reflet the type model the agency was interested 
in. Furthermore, having decided to fund child a<Jvocfi|rCy pro- 
jects fiuid not being sure what was meant by this, federal 
agencies also insisted they wanted a high degree of community 
involvement or participation (without defining what was 
meant by that) from communities, that knew even less about 
child advocacy. For the most part^ the concept of "community 
involvement" or "community participation" was defined in 
very narrow terms. That is, as establishing a policy-making 
board composed of consumers or program beneficiaries. One 
( ' result was that a group of six projects funded by BEH/NIMH 
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found themselves under constant pressureo to establish 
elerrted, active, policy-making boards with such membership . ^ 
As will be discussed in greater detail later, the two pro-' 
jects. that tried" to do this exactly v^ere overwhelmingly un-. 
successful^ in their efforts; the remaining f our )were con- 
stantly faulted for their del^ay in acting on this and for 
their inadequacy ^n achieving it. Yet, the fact is -that 
none of these projects arose in response to community pres- 
sures or initiatives; and only one was able to generate strong, 
spontajieous consumer support for the project during the plan- 
ning and initiation phase. Furthermore, a review of the 
experiences of aaiy other community program begun under simi- 
lar conditions (e.g., the Parent Child Centers) revealed 
that establishment of such a aboard takes almost two years of 
concentrated work -by project directors ^ staff aiid comofiunity 
residents to begin functioning; and another year or two to 
function really independently and effectively. 

Pressure for establishj^ent for this type of board 
within the initiation phase (and generally within the first 
year) created unnecessary problems for several projects and 
is indicative of the unrealistic expectations of funding agen- 
cies and eyaluators who view project accomplishments within 

the framework of such guidelines. In general, explicit 

^ 

"^These^ projects were funded Jointly by the Bureau 
of the Educationally Handicapped (BEH) and the National 
Institute of Mental Health (NIM^J. 
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guidelines from BEH/NIMH projects were rather vague and 
general. Hoj/ever, during^^the course of the first year.it 
became apparent that many more implicit guidelines did 
exist;, often in memoranda circulated among agency staff but 
not revealed to project directors. Thus, dtuations were 
created in which projects were^ suplt>o6®d meet implicit 
but unfeuniliar and unknown criteria. 

A second area of conflict arose in relation to the 
th^^ee Parent Child Center-Advocacy Projects. The Office of 
Child Development awarded $100,000 iTdr each o£ seven Parent 
Child Centers to develop new advocacy components in addition 
to their ongoing programs. The guidelines for this new 
component stressed the importance of the Parent Child 
Center's target community's identification of the needs of 
children (0-5) and their families and an indication of what , 
the community's priorities were with regard to these needs. 
However, the national Parent Child Center guidelines all 
stressed pre-natal and neo-natal maternal and child health ' 
care. All the initial meetings with project monitors and 
federal administrators from OCD, also emphasized the provi- 
sion of maternal and child health care as the essential un- 
met need. Th^re^is a built-in contradiction in guidelines 
stressing the need for comm\inity identification of needs and 
priorities at the same time as agencies are told specifically, 
by the funding agency, what those needs and priorities are 
to be. In three of the projects studied, conflict over this 

I 
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definition of need emerged at the onset. First the question 
vias raised, if the community was to identify its own needs 
and priorities, mighit it rejqct the idea of child advocacy 
altogether and opt for, increasing direct service provision 
or for some other alternative? Second, once the project and 
the communi'ty accepted the fact that %he special grant was 
for eiiild advocacy only, the question raised was "why send^ 
people out to interview families In the community about 
their needs, if they have already been defined for us as 
mAtemal and child health care?" Finally, when initial sur-- 
veys of the commianity were completed, in all three projects, 
the, number of pregnant v/omen were much fewer than had been 
anticipated; and the number of teenage mothers was fewer. In 
two of the three projects, the number of children aged 0-5 
was substantially less than projected. These projects then 
found themselves in a situation in whi&n a variety of needs 
had emerged in the community v/hich were not necessarily re- 
lated te'-needs specified in the guidelines or In the instruc- 

tlons from Washington. Concern was expressed by several 

-J 

directors as to whether the project could respond to other 
needs; whether they would be evaluated with regard to achieve 
ments In providing maternal and child health care; If they 
could only focus on the latter and it was a relatively un- 
important need in their community, what should staff do? 
It would seem that if there is a situation in v/hich the feder 
al government is convinced of ''the need for a particular ser- 
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vice anfcl wants to ensure its provision (and there are 
obvious illustration:^ of this) why go through theH fiction 
of requesting community identification of needs a/ince the 



potential for non-agreement is sol great and the^^ult so 
likely to be conflict an(i communitiy resentment? 

^ The issue of community identification of needs and 

priorities leade to a second area of conflict resulting from 
funding agency directives. That is the frequent confusion 
around the instrument employed for exploring community 
needs - a door-to-door or telephone survey of familiao by 
project staff, r Fiv^' of the projects developed question- 
naires for surveying the community around needs and priori- 
ties. Two other project)? refused to follow the funding 
agency's directive regarding this because of community re- 
sistance. N\imerous surveys had already been completed within 
recent years and community residents refused to comply t^ith 
another survey, suggesting that such data were already avail- 
able. In two other cases federal agencies had supported 

such research but the reports were unavailable to project 

V 

directors >y For the five projects that tr|ed to implement 
this survey, three designed a questionnaire and sent staff 
out into the community. The remaining two, funded by another 
HEW agency, were told that their questionnaires must be 
approved by the Office of Management and Budget before being 
used. One project submitted its questionnaire in May, 1972 
to its project monitor and still had , not received approval in 
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November o'f that year; the second submitted it in July and 
had not received any respoRse by November, For both projects,^ 
staff time had been allotted to the survey arid the result 
of the prolonged and unanticipated delay vf^s a substantial 
under-utilization of staff. In addition, program develop-; 
ment, geared to the result of the planned survey, could 
not proceed. There appears to be some contradiction in the 
fact that two agencies in one federal department follow suc^ 
totally different approaches with regard to the development 
and use of a questionnaire for a community survey. It is 
understandable that communi^i^^^^siden^ might be sensitive 
about being interviewed and there might be a valid issue 
regarding invasion of privacy. However, if this is the caie, 
it would^ appear that the decision should be made by thfe ^commun- 
ity, not the federal government. And if the federal govern- 
ment is making it, at least it should be made consistently. 
Finally, if approval is* to be granted by another federal 
agency, surely it should not take more than seven months, 
especially when one considers the limited life s^an of most 
of these projects. ^ 

Two other problems related to federal fiinding arise 
out of the confusion around what a research anoVdemonst ration 
project, is and the consequences of short-terro funding for 
new and innovative service delivery projects. Fourteen of 
the seventeen federally funded projects arg;;:^ocated in pover- 
' ty areas, /principal investigators and directors or several 
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of these projects (needless to say, they requested anonymity) 

indicated that their projects were really not "research and 

demonstration" projects but were rather structures for 

channeling money into the commtinity by 'providing. Jobs for com- 

munity residents (an approach similar to that of many of the 

anti-poverty projects). Within this context, one black 

director of a project situated in a ghetto community pointed 

out that: \ v^;' 

The time for this approach is past. Providing Jobs 
for a few people is no longer , defined as adequate^ 
criteria for establishing a new project. If the 
^feds are going to put money into research and demon- 
stration projects, let them find good models of high 
quality service delivery. New projects that are un- 
clear about what they are trying to accomplish Or are 
similar to other previously unsuccessful projects 
in the community should not be funded. Inste^.d, con- 
centrate if necessary on a few" rWally imaginative 
approaches of proven existing models and provide 
enough money for a sufficient period of time to ac- 
complish something. , 

Not only is there serious interest around. the country 
in real program, innovation and valid research and demonstra- 
tion projects, but related concern is expressed regarding the 
nature of federal funding, in particular the "short-term" 
approach such funding tends to follow, and the consequences 
of this for innovative efforts at service. delivery. As is 
obvious fr^m the. findings of this study, the start-up period 
for new projects is much longer than is generally recognized 
(between one and two years). Considering this, funding pro- 
Jects for one year is meaningless and even three year funding 
ends for many projects when they have Just become fully opera 
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tlonaj. Realistically, the investment in setting up new 
projects cannot be{^in to pay off until sometime in the 
third year^, shortly before the demise of many of these. 
Although several projects are trying to generate local 
financial support,^ the problem^^^ obtaining this can be 
seen if one looks at a voluntary network of community-based 
projects ^which also used a three year time frame as the 
basis for assured .funding and asjsumed that ^individual pro- 
jects^ could be selTrSupported locally, subsequently. Ex- 
cept for one project, this has not worked and the central 
organization has acknowledged the problem but has not yet 
beep«^uccessful in solving it. 

' ^ The ma jor« consequence of this type of funding is 
that just, as a project is ready for an^ impact evaluation 
study, its funding ends, often before an accurate evaluation 
of outcome can be made and regardless of whether or not ^ 
the project is a success or a failure. 

' . - _ \ 

The Target Community J ' - 

^ ^ A belated recognition of the importance of the 
target commxinity as a factor in influencing the development 
^ of a child advocacy project emerged in the course of this 
study!! In particular, it is a 'factor that should be more 
carefully considered when planning a new project. The 
degree of commun4ty cohesion (as contrasted with community 

fragmentation) , directly influences the time and effort re- 
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quired ^to Obtain community participation In planning and the 
success In establishing a new proJe(^t. As mentioned earlier ^ 
the previous ' experience communities have had with federal 
projects also Influences their attitudes toward newly estab- 
lished child advocacy projects. For exanqple, six communities 
that had beeh^looded Jby new and short-term projects In the 
sixties' were highly. suspicious of child advocacy projects. ' 
Four of these (and an additional two) were In communities 
that had been heavily surjreyed and studied by neighboring 
universities and teaching hospitals and rejected any project 
t^t was premised on Instituting a >"commurtlty survey.^ Not 
onl^ did a compromise have to be wdrked out^ but one community 
that was particularly "gun-shy" fibout research almost rejected 
the project In toto until It wjas^glven the right to limit 
activities of outside evaluators. 

Und^r these circumstances, developing^ constituency 
In the comniurilty for a project requires deliberate effort, , 
^ time, and often. Imagination* Related to this, ^directors 
of the thirteen projects located In underservlced ccMununltles 
are completely satisfied with their choice of target com- 
munities, while the directors of the five projects located 
In "heavily serviced" communities now question the ai)pro- 
prlateness of their choice. The latteV feel that the role 
of the project Is limited* to providing access services and 
case advocacy. Class advocacy Is defined as far more dlf- 
flcult to Implement In such communities and their conclusion 
Is that projects in such communities have much less visible 
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impact than projects located in a cdmmxmity where anything 
accomplished is highlighted. 

In a sense, the problem appears to be perceived in- 
correctly by these directors. It would seem that the issue 



appropriate diagnosis of the problem or nfeed in a community 
Which would then lead to the selection of appropriate ob- 
jectives, targets and strategies. Instead, these directors 
are saying, in effect, given a particular objective, we 
should have chosen a community that would have facilitated 
its achievement. This may be valid for projects claiming 
that the funding agency defined the objectives, but not for 
those free to define them as they saw the need. Regardless 
of which perspective is employed, it is essential for the 
planner of new projects to understand the role the community 
may play in enhancing or inqpeding project development. ^ 

Advocacy Goals, Objectives and Targets 

The creation of child advocacy projects is aF much 
a reaction against how other agencies, organizations, and, 



One difference between commxmity action programs ancT child 
advocacy programs may be that the latter do not appear to re- 
flect conflict between the "competent community" and the 
"competent program." On the contrary, it seems that the more 
competent the community, the more competent the program, thus 
implying ^ that comm\xnity , competence must come first. 



is not necessarily sele(c^||on of an xmderserviced community 
versus a heavfly serviced one, but rather the need for an 
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institutions are serving children as it is a response to 
re-ordering children's needs in our system of national 
priorities. In selecting objectives and targets for in- 
tervention, projects that are based at the community 
level must recognize the importance of selecting those in 
which intervention is possible from their community base* 
If more powerful targets are selected, projects must de- 
velop appropriate strategies, for 'example, limit the number 
of targets addressed; focus on a circumscribed segment of 
a major target; or expajid the power base of the project. 
As f\irther illustrations almost every project in the study 
includes an 'individual school or local school system as one 
or more of the targets addressed. Projects which appear 
most successful either provide case advocacy to a limited 
number of children or classes vi thirl one or two schools; 
select the school system as the only target addressed by the 
project (thus permitting the development of uniform proce- 
dures for handling advocacy cases and developing staff exper 
tise regarding this target system); or organize coalitions 
with several other community, county, or even state organiza 
tions arouAd specific issues such as changing a state law* or 
bringing a class action law suit, 

A realistic approach to the selection of objectives 
and targets woiQd include some recognition of what the 
community defines as important, some selection of what can 
realistically be achieved, as well as decisions about stra- 
tj^gies^ for achieving it. The head of one project dbmmented: 
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Community-based projects can effect only very limited 
change at limited local levels; thus their objectives 
should be circumscribed and realistic. Prograjns which 
have as their obJect;Lves rhetorical goals^about major 
institutional change are unrealistic and should not ' 
be funded. At best, eommiinity-based projects can at- 
tempt to create a community conscience which may then 
begin to generate some activities for more important 
change. 

Another problem in relation to goals and objectives 
lies in the confusion between objectives and strategies .""^ 
Many projects find it difficult to separate the two) and 
thus find goal achievement impossible to attain. For ex- 
ample, one community-based project which provides direct 
services afe a strategy for obtaining credibility in 'the 
commxinity or mobilizjjig^'^constituency^ the pro- 

ject recognizes that such provision is strictly functional, 
and may gradually eliminate it. In contrast to this, another 
project that provides direct services because other agencies 
make referrals to it and community people expect service, in 
time may permit the direct service program to become the to- 
tal project component and may lose sight of its original 
objectives. A related issue is whether or not advocacy can 
be practiced' in communities with substantial quantitative in- 
adequacies in services. Additional study may prove that^ 
effective inlplementation of advocacy may require the existence 



For example, the Progress Report of one project 
states: "The YDPPA strategy is to divert children from the 
Juvenile Justice system, avoid negative labeling of children, 
reduce alienation among youth, and develop greater access on 
the part of youth to socially desirable roles. The program 
achieves these objectives by providing direct services and 
by bringing about Institutional change." (Emphasis added) 
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of certain basic service minima in a commimity. 

One final problem regarding specificity of objec- 
tives is the potential conflict between the need to specify 
objectives as early as possible in planning a project and 
the simultaneous need to maintain flexibility and openness 
in a project, not delineating criteria for evaluation so 
early that the project is frozen into rigidity at its in- 
ception. It would seem that the prpcess of achieving 
goal specificity has to be defined as a matter of degree, 
increasingly delineated . over time. Certainly this seems to 
be the case in the most successful projects in this 6tudy. 
Thus, an initial objective of one project was to ensure 
that the school system be made more responsive to the needs 
of students. During the initiation phase, goals were fifrther 
specified to include the development of a formal grievajice <^ 
procedure to handle individual student complaints; chahging 
school policies (permitting pregnant girls to remain in |^ 
school; permitting lay advocates to accompany students at ^ 
disciplinary hearings; using school buildings on weekends); 
ensuring provision of students legal rights; changing legis-r 
lative^odes. Almost all the directors of projects studied 
(in particular, all the "successful .^|^^ertaih" and even 
one of the "failure" group) recognize themselves that their 
goals tend to be too broad and too diffuse. The most success- ^ 
jhil projects are the ones that seem to be. most aware of this 
problem and are constantly striving to narrow their focus 
and esta*bH^sh priorities. Delineating priorities unfortunately 
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presents problems for many organization© both new and well 
established, so learning how to do this may merely be an , 
Inevitable part of a projects "growing: pains. " 



- Advocacy Processes 



Almost half the projects (10) were established on 
the assumption that they would provide both case and class 
advocacy with case etdvocacy providing the caW findings that 
In time would Identify class advocacy Issues and docvipient 
positions. Since four of these stated that class advocacy 
would not be Implemented until the third year of the project 
and none of these was In Its third year at the time studied. 
It may^be unfair to note that none of the four ajid only one 
of the remaining group of six established on this premise 
has managed to Implement classvadvocacy. On the other 
hand, two projects- that successfully provided class advocacy 
did so soon after beginning provision of case advocacy. How- 
ever, this action was not premised on Individual case advocacy 
findings; Instead, In these projects class advocacy Is 
defined as having a dlffex^nt substantive i>ase and Is handled 
by separate speclcLLlst staff. Including lawyers. 

One of the most Interesting findings of the 1971-72 
national survey of child advocacy was the high incidence of 
projects providing both case and class advocacy. Since pre- 
vious experience and all evidence reported* ii^ the literature 
indicated the inevitability of conflict when both types 
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were provided by one organization, the apparent shared 

existence of case euid class advocacy in child advocacy 

\ 1 
projects was quite noteworthy. 

All twenty-three of these projects were in last 
year's study and all claimed to be providing both types of 
advocacy at that time. Only four were in fact doing so at 
the time of this stady. One obvious cojuclusicm is the one 
mentioned earlier - the fallibility of mail surveys. Another, 
of course, is the difficulty in knowing what in fact is being 
provided in the project when a new facet of the progreun has 
Just been initiated. That these projects emticipated pro- 
vision of class advocacy as well as case advocacy is \m- 
questioned; that there is a large gap between the anticipa- 
tion, the plan, and the implementation seems quite obvious 
now. 

Thusr one reason that child advocacy piqjects appear 
able to enconqpass both case and class advocacy Is that they 
are only providing the former and still planning provision 
of the latter at some future point (once the project has 
received substantial community sTq>por;t^r the need for class 
advocacy is well doc\amented empiriccLLly) . It is still possi- 
ble that this dual thrust Is feasible, ijowever, there is 



For extensive discussion of the potential conflict 
between case and class advocacy, see references to articles 
by Edward J. 0*Donnell listed in the bibliography. In siqpport 
of this conventional position, see also, Chafrles Grosser, 
Helping Youth ; Kahn, Studies in Social Poli)Cy and Planning , 
(New York: Russell Sage Foundation, 19b9) ,/ chapter vili m con- 
trast to his earlier position, O'Donnell recently stated that 
current research on multi-service centers seems to indicate that 
case and class advocacy can be provided by the same organiza- 
FR?r (Personal Communication, June, 1972) 
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no evidence in current child advocacy practice to support 
Ihls cpnclusion. In fact, one "successful" project has 
supported the conventional position that the two conflict 
and that cl^ss advoc^y at the community level is not 
feasible because it requires the active support of indivi- 
duals whose only real concern is their ovm case and who 
do not want attention drawn to their problems. 

With regard to the four projects that do provide 
both case and class advocacy, two explanations are possible. 
First, in three of the projects, separate staff provide 
each type of advocacy; lawyers in particular, are utilized 
for the provision of class advocacy either through class 
action suits or through identification of targets, appro- 
priate strategies €uid the training of lay staff. Second, 
is the possibility that it is not class advocacy (or social 
action) per se that conflicts with case advocacy (or direct 
services) but rather the nature of the strategies employed 
In achieving the relevant objectives'^ For example, charac- 
teristic of all these piqjects are the consensual, non-conflic- 
tual strategies employed in achieving these objectives. 
Fact finding, persuasion, negotiation, publicity, the use 
of influentials, community organization and community pres- 
sure, the development of coalitions and broad-based con- ^ 
stituencies, and lobbying are standard techniques; adversarial 
positions and direct confrontation tactics are played dc5wn. 
Although the threat of court action was important in getting 
initial recognition, the director of one eminently successful 
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case and class advocacy^ project said that after two years 
of operation, direct confrontation techniques were used 
Increasingly Uess and were defined by staff as less neces- 
,sary as their knowledge and expertise grew. Documentation 
of positions taken - buttressing these positions by facts 
and knowledge of relevant laws and statutes - Is Identified 
as the most effective strategy for successful advocacy at 
both the case and class level.. "Argue from and with the 
facts. Forget the rhetoric, the emotional positions, the 
Irrational fighting." This Is the approach described as 
particularly effective In changing policies and procedures 
In formal bureaucracies or In changing the attitudes of hos- 
tile professionals^. As the director quoted above statfed, an 
approach such as this explains why a project may be able to 
provide class advocacy without antagonizing those service 
systems providing services to lndlvld\«l clients also. 

A related Issue may be the fact that regardless of 
whether the advocacy activity Is case or class -focused, the 
object or target of Intervention for commxinity-based projects 
tends to be a service system. Institution or organization. 
It Is not political action jper se although political action 
to benefit all children may be far less threatening than 
political action to benefit the poor and minority groups. 
The avoidance of activity directed at Increasing the political 
power of the consum^ group may also contribute to the 
apparent lack of conflict between case and class advocacy In 
^ those projects Incorpor^lng both. Finally, one other possible 
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reason for the potential compatibility of these two types 
of advocacy is that class advocacy may be the implicit 
long-term goal of all advocacy projects. In this context, 
case advocacy becomes the primary strategy for case find- 
ing and ddpumentation of issues in class advocacy. For 
projects that view class advocacy as primary and case ad- 
vocacy as the base from which it can be implemented, there 
should be no conflict since the interest of the individual 
clients would be expected to be subsxamed under those of the 
group. Thus far, however, there are no actual illustrations 
of this approach and no data to support its viability in 
current practice.. 

Two other comments may be made about the types of 
advocacy provided. First, lay advocacy is overwhelmingly 
predominant at the community level. Where legal staff is 
employed, their role is essentially that of ancillary staff , 
specialists or consvdtants. The core project is lay -admin- 
istered. Second, external advocacy, in contrast to internal 
advocacy, is equally predominant. There are only two internal 

advocacy projects in the group studied and one of these 
« 

never even got the ground. Internal advocacy, in par- 
ticular, monitoring the services from within a single insti- 
tution, is apparently much more difficult to implement, than 
Lt appears. Obviously, one cannot draw any conclusions from 
a sample of two projects; yet it is interesting to note that 
the successful one of these two is strongly supported by the 
top administration in its sponsoring institution while the 
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"fal^re" never obtained administrative support. Some 
possible questions that arise from tkls observation In- 
clude: Can Internal advocacy be Implemented only when 
administrative support Is present? (in a sense this means 
that It can be Implemented where It may be least needed) 
Con Internal advocacy ever be Implemented without such 
support and If so, how? Another distinction between the 
two Internal advocacy projects Is that the "successful" one 
was clear about Its advocacy objectives from the time It was 
first planned ajid anticipated a gradual stiructurlng of the 
program throughout the Initiation phase. The "failure" 
anticipated immediate action and after six months gave up 
trying to provide advocacy at all. 

For almost all the projects providing case advocacy 
the Individual case predominates as the entry point for 
advocacy. Three projects monitoring a local service system 
a?ttempted to use this system as the;/ entry point. The dif- 
ference was that each of these projects used its staff in 
brokerage or liaison rol6s between Itself amd the target 
agency. In each project, the staff foundf themselves in con- 
flict between the two organizations and in all three ended 
up dominated or co-opted by the target agency system. The 
problem seems to be that the monitoring role must be kept 
dominant J if the brokerage role assumes too much Importance, 
the project may lose control of its staff. 

A A ^ ^ A 
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Access and Advocacy 

Considering the fact that case advocacy is the pre- 
dominant type of advocacy at the community level and that 
over one half the projects studied (12) incljide the pfovision 
of access services (information, Ireferral , brokerage) as 
clearly integral to the provision of case advocacy, it seems 
worthwhile to consider the possible implications of this 
relationship. Particularly noteworthy is the fact that all 
"successful" projects included a major access service com- 
ponent and defined it as an essential base for case advocacy. 
One project director commented that a network of locally based 
information and referral services would be an ideal way for 
developing a community-based case advocacy system. In effect, 
he saw a centrally organized, locally based access service 
program linked up to all the agencies in a city as providing 
a network of case advocacy projects. In addition, a cen- 
tralized administrative office could correlate the categories 
of needs and problems identified at the neighborhood level 
and thus document and order issues for class advocacy. This 
suggestion for establishing a locally based access service 
system raises the issue of whether advocacy is more effective 
when provided as one part of a general service or when pro- 
vided by an autonomous and specialized project. As yet, no 
^ systematic ^fort has been made to study such an alternative 
which relates not only to the distinction between. the 
specialized advocacy practitioner and the general practitioner 
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but highlights the speclallst/generiillst dichotomy with 
regard to the organization as a whole. 

Advocacy Structures ' 

This Issue of the relationship of access servlcesy 
to advocacy raises a related Issue also. That Is the 
organizational structure of child advocacy projects ajid the 
kind of structure that most enhances the Implementation 
Of advocacy. One facet of this Is the question raised above 
with regard to the autonomous, specialized project versus i 
the supplemental component of a more generalized program. ' 
Another 'facet , howeyer. Is the type of organizational struc- 
ture - bureaucratic or human relations^- that most enhances 
or facilitates the provision of advocacy. Considering ^he 
fact that these projects all tend to resemble a human rela- 
tions organization with regard to function and nature of 
tasks performed, almost all tfind to be organized along tra- 
dltlonal bureaucratic lines. Most have a N^hree tier hier- 
archical structure with decldlon-maklng centralized In- the 
hands of the director, supervision and trM. nlng controlled 
by him ajad the assistant director, and services provided 
by direct line '^advocate'' staff. Superficially, at any rate, 
these projects seem to resemble a combination of both 
bureaucratic structure and human relations function. 

^ Since there is some question as to the self-conscious 
ness and deliberateness with which these projects develop 



A ^ O tf) 



. / 



225 



their organizational, structure, another area ^r further - 
study might be a more intensive analysis of the relation- 
ship between the organizational structure of a project -and 
eventual outcomes. For exam^ple, five of the projects have 
limited the number of targets addressed by them to a single 
target. Staff training is concentrated on providing rele- 
vant information, techniques for problem identification, 
solution and effective intervention, with regard to the 
specific project's target. In effect, staff become experts 
in dealing with these targets and are often more knowledgea- 
ble than members of the target system. Comparison of out- 
comes achieved by this kind of staff with specialized ex- 
pertise, with more generally trained advocate staff in the 
other three "successful" projects might provide 4n;^ei'esting 



data'.and be frui^Tully incorporated into any instruAient 
developed for outcome evaliiatlon. ^ 



Advocate Staff 

The projects are' staff e4 predominantly by indigenous 
paraprofessionals (15 out' of 23) most of whom are relatively 
inexperienced. On the other hand, projects are actministered, 
almost without exception, by professionals (1^ out of 23) 

V 

who represent a wide variety of disciplines, such as early 
childhood education, special education, law, teaching, so- 
cial work, psychology. Although, in eight of the projects 
most staff have completed professional training, all direc- 
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tors stress the need for more experlehced staff than ini- 
tially employed and the need for more focused and exten- 
sive training for staff even when they are experienced. 

, Project directors continue to stress the importance 
of training yet training programs continue to be haphazard 
and >reak. Very few even exist, let alone seem\^fective. 
The three that appear most worthwhile focus on providing 
substantive expertise regarding one target system or ex- 
tensive and repeated training on an anniial basis. In al-* 
most all projects, the request for training man\xals, materials 
and general training expertise are ever present. 

^ Related to the whole issue of trdning, in particular 
for paraprofesslonal staff, is the pervasive problem re- 
garding the transferability of staff training, experience^ and 

expertise. In talking to staff in many of these projects as 

t 

well as to their supervisors and administrators, grave con- 

^ ■ . - y 

cern is expressed for the future of competent paraprofesslonal 



staff who^e lack of formal credentials limits their ability 
to obtain comparable Jobs, in particular at a time when social 
programs are losing flfeidlng and personnel is being discharged. 
Therefore, it would seem essential that when planning train- 
Ing programs for staff, considerable thought be given to 
developing a work-study program with a neighboring college 
or university so that at least some credit caji be earned 
towards an. eventual degree. Where possible, preference should 
be for developing a training pit) gram which will culminate in 
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at least an associate of arts' degree. 

There does not appear to be any significant differ- 
ence between what either professionals, paraprofessionals 
or volunteers actually do when they "advocate." Certairdy, 
case advocacy is as likely to be implemented effectively 
by paraprof essionals as professionals. As mentioned earlier, 
where class advocacy is concerned, there does seem to be 
a difference, that is, either specialized^ staff are involved 
or the administrators or directors of the pfoject carry 
out class acj^vocacy. This may indicate that provision of 
class advocacy requires professional staff. However, only 
further study can confirm this. 

Finally, of the eighteen projects with paid staff 
(not Just paid administrators) all have full-tim^ staff, 
even though five initially employed part-time staff. Elimina- 
tion of part-time employment is particularly characteristic 
of projects which stressed the hiring ot indigenous para- 
professionals only. Although' in st^me cases, staff said they 
neede|l full-time employment and pressured for theiiS^changed 
status j^_p|*oJect directors generally claimed that part-time, 
paraprofessional employees were not an efficient and 
effective work force and that they required too substantia 
an investment i^/t^raining and supervision to warrant the 
limited return provided from their part-time employment. 

One last com^nent relates to the use of paraprofes- 
sional staff, the dominant staffing pattern in theae pror 
Jects. Indigenous paraprof essionals first became an important 
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factor In staffing social programs during the 1966s In 
the anti-poverty programs. Their use, value, aund the 
possible problems related to such staff have been exten- 
sively discussed elsewhere ajad^th61r primary value Iden- 
tlfled as providing a bridge or link between professional 
staff and the Immediate community."'" (An alternative ra- 
tionale stresses use of paraprofesslonals In order to 
provide needed Jobs.) 

Although some of the problems Identified In these 
projects have been recognized before, such as the Issue of 
maintaining confidentiality regarding Information iibout 
other members of the commxinlty, one particular problem seems 
underscored here. Por the most part, these paraprofesslonals 
are not being used as links with the community, but are 
rather being trained to work as pseudo-professionals, with 
the result that they often end up In a no mans land, with 
neither^ the credentials or expertise for professional Jobs 
nor credibility In the community. Xt seems as If the con- 
cept of the worker as "bridge" has been rejected both by pro- 
ject administration' and by staff. Although this Is not a new 

ISee Sherman Barr, "Some Observations on the Practice 
of Indigenous Npn-Professlonal Workers," In Personnel In 
Ahtl-Poverty Programs : Implications for Social Wo^^ Education 
(New York: Council on Social Work Education, 1907) PP« 51-02; 
Gertrude Goldberg, "Non-Professionals In Human Services," In 
Charles Grosser, William E. Henry and James G. Kelly, eds., 
Non -professionals In the Human Services (San Francisco: Jossey- 
Bass, Inc., 19^9) pp. 12-39. " 
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problem, the consistency with which It appears In these 
projects may be indicative of the problem projects have 
generally with ensuring accountability to consumers. Pro- 
jects have attempted several conventional approaches to 
^providing client and consumer accountability, one of which 
ISp the use of indigenous staff. As will -be discussed lateV, 
the inadeqxiacy of existing devices for ensuring accountability 
may reflect the fact that the administration gets carried 
away by form and structure and falls to support the explicit 
function in practice. This problem of accountability and 
the confusion between structure and function will be discussed 
again. 

Leadership 

At the^ completion of our natlon&l survey of child 
advocacy, we offered our impression that leadership was a 
crucial factor in developing a successful child advocacy 
project. This impression is more than confirmed by the 
findings of the current study. The role of leadership is 
critical in the planning phase qf child advocacy projects - 
from the importance of individual initiative in stimulating 
the planning process and the active invplvement of leacjer- 

n ship throughout the process, to the Importance of leader- 

ship responsibility for the preparation and submission of a 
formal proposal. It is critical again in the initiation . 
phase where continuity of leadership between planning and 

O initiation becomes essential, . Successful initiatton of child 
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advocacy projects is characterized, without exception, .by 
the high quality of leadership from the beginning of the 
project through later development. Finally, the little evi- 
dence this study provides regardljng successful implementation, 
seems to indicate that leadership continuity remains in^or- 
tant and that the commitment of leadership to the project is^ 
an essential factor. 

Child advocacy represents an effort at innovative' 
programming. Where a new concept of program or practice is 
being Implemented, strong leadership becomes essential. Al 
though styles of leadership may vary from the charismatic to 
the low-keyed and understated, - all the successful projec ts 

in the study are directed by someone who understands the 

I ■ 

conceptual framework of the project ajid is overwhelmingly 
committed to its goals and objectives. In addition, when 
the leader of a successful project leaves, the project ^f ten 
shows signs of retrogression. § 

It is worth noting that the importance of leadership 
in implementing a new project is a factor that has been com- 
mented on elsewhere, both in theory as well as in practice. 



1 

For another perspective on leadership, see George 
A. Brager anc^ Harry Specht, Community Organizing , Part I, 
pp. 3-06} Neil Gilbert, Armin Rosenkranz and SpecJrt, "Dialectics 
of Social Planning," Social Service Review, Vol. I8, No. 2, 

March 1973, PP. 78-86: 

In another context, Sylvia Porter, writing about the 
importance of leadership and management in business, says, 
"In an overwhelming nine out of ten cases, the reason under- 
lying a business failure will be the manager' s ^Incompetence, 
Inexperience, ineptitude." She implies further, that in a 
variety of organizations - both profit and non-profit - the 
leadership factor is a critical Variable. ( New York Post. May 4, 
1973} 
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In one study effective implementation is defined as being 

contingent on strong leadership in the planning phase. 

....t^l^key to effective implementation is, of* course, 
the degree of commitment to the change felt by cer- 
^ ^tain key participants who must implement it. While 
an orgai)izatiort caji afford to have some members who 
will comply with the new requirements with faint 
enthusiasm and a very few who are in active opposition, 
most of the key figures need both understanding and 
emotional commltmeit if important and lasting change is 
to be effective. This understanding and commitment 
needs to be built during the diagnostic and planning 
phases. If it is achieved at these phases, the imple- 
mentation will predictably go relatively smoothly. -'^ 

An even stronger and more comprehensive statement 
of the importance of project leadership is made in a report 
put out by the Ford Pojindation on the evaluation of its own 
school project during the 1960s. One of the conclusions of 
this study is that "... the succ^ess or failure of the pro- 
ject probably was determined more by the performance and 
continued service of the project director than by any other 
single factor. " Purthe/ confirmation of this point of 
view may be found in the subsequent statement that "...there 
was a distinct tendency in most cases for the director who 
was present at the creation (of the new project) to remain 
faithful to the project,..," while project directors who were 



Lawrence and Lorsch, 0£. cit . ^ p. 88. 

2 

A Foundation Goes to School , The Ford Foundation ' 
Comprehensive School Improvement Program, I96O-7O, p. 33. 
(Emphasis added) 

^rbid. , p. 34. 
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selected after a grant was made tended to have both more 
limited leadership capai^lty as well as more limited com- 
mJLtmeht to project goals and objectives; Plrmlly,-the 
Ford report comments on the fact that high dependence of 
projects on Individual leaders was compounded by their 
high rate of turnover. Thus, wl»en directors changed, the 
basic Interests and capabilities of the projects changed* 
"Exlsten£ prlprltles were abandoned or neglected, new ones 
were established, and resources had to be devoted to gear- 
Ing-up again and resolving the uncertainties th^tt accompany 
that process. In a few Instanced, the replacement of direc- 
tors led to project Improvements, but In most the effect 
was detrimental."^ Similarly, for this group of child 
advocacy projects, at least half the directors changed within 
the flri|t two years of the project's existence, with simi- 
lar negative co^jsequences. An even clearer Indication of 
this problem may be seen In a project which appeared highly 
successful when Initially visited In the course of this 
study. When re-vlslted six months later, five months after 
the director resigned to return to graduate school and three 
months after the assistant director left, the project had 
lost Its "sense of direction," the program had changed and 
staff morale had deteriorated. 

V 

Boards: Structure and Function 

» 

Establishing a board (advisory or pollcy-maklngj lay 



•1 

Ibid , 3 pp. 33-34. 
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professiona|^or both; consxamer, elite or comblnatlonj actively 
participating or ad hoc) is one of the major organizational 
tasks for nev child advocacy projects. Of the twenty-three 
projects studied^ ten had no board at the time visited^ 
either through deliberate choice or because of problems in 
the organization and establishment of a board. The remaining 
thirteen had some form of boards usually advisory^ and usu- 
ally meeting on an ad hoc basis (if at all) with little in- 
put into the project. Two projects had policy-making boards 
composed of a combination of elites and professionals. In 
one^ consumers were included aJLso. In ten projects ^ all 
members were appointed to the board by the project director 
and specifically selected because of their commitment and 
enthusiasm for the project's objectives. One other project 
has a similarly composed advisory board. Three projects 
established policy-making boards with membership elected by 
community residents and of these two were defunct by the end 
of the first year and the third was in such difficulty that 
the director did not call for new elections at the end of the 
board's term of office and the project was without a board for 
six months before the^ second efforts were made at organizing 
a board. 

Six of the projects, funded by one federal agency 
were under heavy pressure to establish an elected policy- 
making board with substantial community representation and to 
' do it within the first year of the project's life. The two 
projects that attempted this had problems throiighout the year 
O as a result. Two of the other projects established an appoint- 



a 



\ 



234 



€d advisory board and were faulted for this while the re-- 
maining two established no board at all. Several other 
projects were under similar but less intense pressure to 
do the same 'thing. 

After visiting twelve projects and interviewing as 
many directors it seemed obvious that establishing such a 
board pr.esented substajitial problems for every project. 
In an effort at obtaining some additional pei^spective, sev- 
eral directors of older child advocacy projects or other 
community action programs were questioned as to the viability 
of elected, policy-making boards. Without exception, the 
eight directors interviewed all stated that establishing such 
a board composed of elected cotrmiunity representatives, re- 
quired at least two years of concerted effort; for it to 
become involved in makl|ig policy also, required another two 
years. Thus, criticism of these child advocacy projects for 
not establishing such boards after one year of operation, 
seems highly unreasonable and unrealistic. 

In reviewing the experience of several other projects, 
certain characteristics appear to affect the length of time 
it takes for a board to become operational and the' type of 
problems that may emerge in the process. For example, boards 
composed solely of elites and professionals take the least 
time to be organized and become functioning. Although boards 
composed of lay people only may have difficulty in defining 
role and function, boards composed of both professionals and 
lay people (or consumers) with the latter group less educated, 
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unsophisticated^ and -inexperienced (or a board composed 
of experienced adults and Inexperienced youth) are most 
difficult to organize and to get operating. In four 
projects where boards were similar to that described 
above (professionals and inexperienced youth) the pro- 
fessionals or the adults tended to dominate and either 
the other members withdrew or became actively hostile, 
creating constant internecine conflict within the board. 

One project director suggested that if the estab- 
lishment of' an elected policy-making board composed of 
community residents was supposed to be a major project 
objective, a structured approach to phasing-in the board 
should be followed. For example, he suggested that six 
months be spent in organizing the comrnxinity, identifying 
issues and preparing for elections^ three months should be 
spent in training those people elected for membership on 
the board in their roles, duties and board procedures. This 
should be done as a first step in establishing a new project 
before any other part of the program is developed. 

Administrators and funders should be prepared for pro- 
ject directors to spend the firsts six to nine months 
just getting a board organized. It has to take at 
least one year for the organizational structure of staff 
and board to learn to work together before a program 
can begin to be established, let alone become opera- 
tional. 

An alternative approach to supporting community 
participation was suggested by two other directors. Their 
idea was that projects should establish two advisory boards, 
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one composed of professionals and elites and the other com- 
posed of consumers and lay people. Only when the lay board 
becomes really cohesive and self-confident should the two 
be integrated. * 

A third suggestion, aiY^ like the previous ones 
made also by the director of a child advocacy project located 



in a minority commvinity, was that elected membership could 

work only if the oommvinity was highly organized and had a 

\ 1 

strong sense of commxinity cohesion. In fragmented or dis- 
persed communities only appointed boards can be established, 
' and be effective. 



communities and serving minority populations all stressed the 
fact that the elected boards were a waste of time and effort. 
One said /^appointed, committed people who have expertise is 
far more important than holding elections and having a repre- 
sentative board, especially since such boards are never 
really representative^ " 

SANCTION, LEGITIMACY, AND ACCOUNTABILITY 

Establishing a board - one of several organizational 
tasks in the initiation phase of project development - receives 

m 

^Or, to use Kramer's terms, a '^competent community'* 
is essential for the development of a'^competent program." 
Kramer, o£. cit . , p. 203^ 



The directors of six projects located in ghetto 
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exaggerated Importance, by project directors because it Is 
defined as so important by funding agencies. It is cer- 
tainly not a primary factor influfenclng the success or 
failure of child advocacy projects. Indeed, it is a per- 
fect Illustration of the inappropriate weighting given to 
a stxnictural variable without analyzing Its relevance for . 
goal achievement. The important question is what is the 
function of a board? Is this function essential for the 
effective development of a child advocacy project? Is the 
board the only device for provision of this -function? 
Among the more important functions of a board are: to pro- 
vide sanction and legitimacy for the project, to provide a 
channel for community participation in the program and to 
ensure accoxmtability to consumers and other groups within 
the community. 

The traditional policy-making boards in voluntary 
organizations provide power, sanction»,and legitimacy from 
the fact that they-^ntrol the actual source of funds. Often 
they either give the funds directly, represent groups which 
provide funds (e.g., foundations) or do direct fund raising. 
Since money is the single most important factor influencing 
project development, controlling the source of money becomes 
equally important in influencing, if not determining policy. 
In such organizations the board selects the executive direc- 
tor aha makes all major policy decisions. 

In contrast to this, boards of ^publicly owned corpora- 
tlons are handm&ldens of management. They are selected by 
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management, identified with it, and are essentially advisory, 
not policy-making. Unless there is a fight for control of 
the organization, they always back management and never 
determine policy independently. They change at the direc- 
tion of management or when management changes. In such si- 
tuations the board provides sanction or legitimacy by 
supporting "the project director'' and reinf orciffg" 7ilS^leader- 
ship a.iu position. ' - - 

For these child advocacy projects the one thing the 
board doesnotdo is directly control the funds, thus it 
cannot provide sanction and- legitimacy in this way. ^ In some > 
cases, however, it does function as back-up and support - 
both advisor and '^claque'* - to the project director; but in 
those instances the board tends to be ad hoc, meet irregularly 
and have little influence. In reality, the major issue in- 
volved in stressing the importance of a board, is the search 
for ensuring accountability. Unfort\mately , the assumption 
is that the board is the only device that can achieve this. 
When public funding is supporting an organization, by defini- 
tion the organization must be accountable both to the pulilic 
at large (thus the community in^which the project is located) 
and the public it addresses (its specific consumers). Com- 
munity representation on boards becomes a false issue mask- 
ing the real one of community accountability. Although 'elect- 
ing representatives to the board of a project is one way of 
providing accountability, several other ways exist also. 
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Furthermore, electing representative board members who are o 
not committed to' project goals and are not prepared to make, 
a substantial investment in time and energy in board activi^ 
ties will not provide any more accountability to consxixne^Ss - ' , 
and probably less - than members who are deliberately select- ' 
ed from among those consumers who appear particularly inter- 
ested, competent /have time and are willing to work. If 
yect wants to demonstrate its representativeness, one 



^pther way it can dp this is by hiring indigenous staff or 
staff Representative of consumer groups (although there are 
potentjal problems with this approach also, as mentioned 
eaj-ller). Other approaches include two projects where con- 
sumers were hired to work with those planning the project 
{a variation on advocacy planning); in another, groups of 
consumers were orgeinized to evaluate the project's activi- • 
ties and services. The latter is the nearest thing to an 
inndvative device that appears to exist; most approaches to 
ensuring accountability " exist more in rhetoric than, in p'rac- 
tice. Unfortunately, this study confirmed the conclusions of 
the earlier one, that there is great need for new social in- 
vention in this field. Project -planners i directors; and funders 
talk about accountability but little is actually being done 
about it. ' 

sm<mRY 

In summary^ the present study, confirmed the importance 
O of certain variables initially identified impressionisti<?ally 
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as ".important : funding agency influences; advocacy objectives^ 
processes and targets; the relationship of goals, process 
and ^tn^ture; the overriding iinportaj:»ce of leadershs^p. it 
Identified certain othe^ variables whose importance was not 
adequately recognized in the earlier staidy, in particular 
the nature of the target community and tic existence and ex- 
tensiveness of staff training. It reinforced initial con- 
cern regarding the exaggerated importance placed on certain 
structural variables, in particular, the board. Finally, 
it confirmed 'the existence of a vacuum surrounding the 
development of devices and other forms of social invention 
to ensure accountability. This becomes particularly cri- 
.tical for advocacy projects which are presumed to act as 
spokesmen for their consumers ajid thus must invent mechanisms 
that\guarantee such accountability. 

^ '1 . ■ ^ 
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CHAPTER IX ' , . 

REFLECTIONS 

% This study was designed: a) to describe the process 
by which comnmnity -based child advocacy projects are started 
and become operational; b) to identify possible patterns in 

. this process and conceptualize, them; and^^^c) to learn from a 
review and analysis of the process what kind of strategy - 
and what kinds of criteria could be developed for evalu- 
at ion purposes. 

The process has been described and analyzed. It' 
shovild be noted, first, that the process itself is -substan- 
tially more complex and takes far more time than is generally 
known or recognized. Second, it was discovered that develop- 
mental phases could be identified and conceptualized: planning > 
initiation and implementation. Third, phase-specific cri- 
teria were developed for evaluation purposes, but the initial 
V expectation that impact or outcome criteria wo\ild also be 

identified, proved not^to be feasible. In the course of dis- 
covering how long a project takes to become operational it 

J^became overwhelmingly clear that one criterion for sample 
selection - the two and one-half year age limit on projects - 
had, in effect,' eliminated almost all projects that might 
have been far enough along developmentally. Thus, the study 
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sample sl^ly could not provide an adequate empirical base 
from which s\ich outcome criteria could be developed. 

The study was planned to include efforts at botii 
formative evaluation (assessing local efforts to identify 
effective strategies and project development) and summa- ^ 
tive evalmtion (assessing the impact of the program, in 
particular at the over-all level). Again, only criteria 
for formative evaluation could be developed, because the 
vast majority of projects were not at a stage where summative 
evaluation was appropriate, reasonable or feasible. What be- 
came important, therefore, was to identify euid analyze the ^ 
factors precluding other types of evaluation. In short, why 
was it not possible to look at effects and effectiveness 
and to review 'and assess output systematically? Included 
among the exploratory variables are: the number and types 
of tasks accomplished between the time a project is funded 
g»nd when it first begins to provide advocacy services, ac- 
tivities or actions regularly; how long a period of time this 
process takes; and finally, what factors seem to make a dif- 
ference along the way. (With reference to the latter, it 
proved easier to identify factors positively correlated with 
failure than those positively correlated with succesa) 
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However, some tentative comments will be made later 
in the chapter about impact and outcome criteria. 

2see Chapter II for some discussiop of this distinction 
and relevant bibliographical reference s .>>^ 
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In ef f ect§ "then, this study has concentrated on 
evaluation of "program effort,," "program process" and 
"program strategy," rather than "program output" or 
"program efficiency.""^ The study findings offer guidance 
to planners, project directors, and funders; for planners 
de;5igning a new project; for pro^^ct directors viewing 
their own project development; for^^funders in assessment of 
proposals for new projects as well as in the monitoring of 
ongoing project development. 

! V , 

WHAT ELSE HAS BEEN LEARNED ABOUT EVALUATING CHILD ADVOCACY 

PROJECTS f 

Analysis and Assessment of Proposals as the First Stage 
of Project Evaluation 

Employing the classification scheme developed In the 
course of this study and the differentiating criteria de- 
rived empirically for each developmental phase, an initial 
instrument was developed for evaluating child advocacy projects. 
The instrument was tested in the field. Findings, conclusions 
and appropriate revisions to facilitate further \^^e v:ere 
suggested in Chapter VII. It now seems apparent "that success- 
ful commuaity-based child advocacy projects are few in num- 
ber. Moreover, projects rarely move from failure in one 
stage to success later on. In reviewing all the projects, it 



' -^See Suchman, Evaluation Research ; Tripodi/ Felllh 
and Epstein, op. clt .; Wholey, op. clt . for discussion off 
these tyjies oF^evaluation. Also, Chapter II. ^ / 
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seems clear that poorly planned projects - those characterized 
by niimerous Indicia of difficulty in the planning process - 
are not able to be successfii^-ly imple;fnented. Indeed, although 
successful planning does not necessarily ensure successful 
implementation, unsuccessful, inadequate or poor planning 
does appear to preclude success at later stages. It is ob- 
vious therefore, that the planning phase is\crucial; indeed 
it is the first stage in project development requiring evalu- 
ation . In effect, study findings highlight the importance of 
meticulous review by funders of proposals submitted to them - 
and provide guidelines fpr such analysis and assessment. Care 
ful analysis and vreview of proposals, site vislte, and inter- 



views with relevant planners, potential consumers and com 



munity groups all should be considered before final approval 
is given to proposals for community-based child advocacy pro- 
jects. Rhetoric, diffuse goals., lack of a clear conceptual 
framework, failure to obtain community sanction, all represent 
warning signals and indicia of potential difficulty. Lead- 
ership initiation, involvement and a^ctive participation in 
planning and preparation of the proposal; Involvemient and 
active participation of relevant elements in the community; 
and precision and specificity in task or problem identifica- 
tion as well as goals and strategies, seem essential ing^e- 
dients for "successful planning." ■ 



posals labeled "child advocacy" that show no evidence what- 
soever of advocacy-type objectives and interventions. Further 



Clearly, there is no longer any excuse for f|)dnding pro 
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more, enough is known/ now about these projects to avoid 
supporting probable ^^ailures. Several principal investi- 
gators of federally fur^Vd cl^ilild) advocacy projects com- 
mented critically pn the poor quality of proposals 
funded (often, including their own). In discussing their 
own and other proposals, several suggested that funding 
agencies could enforce much sharper criteria, in particular, 
requirements for far clearer delineations of project 
goals and a clearer concept of project design and objectives. 
Subsequent research devoted to empirical study of other 
types of social programs - and other types of organizations - 
regarding hovf they begin and develop, might reveal how many 
of these criteria are valid for these also, or whether they 
are only "child advocacy-specific," ^ 

The Second Stage for Evaluation: Project Initiation 

Establishing a project softer it is funded takes sub- 
stantially more time than project directors, funders, or out- 
side evaluators anticipate. Only one of the newly established, 
autonomous project^ (as contrasted with components of 
existing projects) was able to be organized in less than one 
year. In general, the process of recruiting and obtaining 
staff, training them, finding physical space (an office), 
mobilizing a constituency, identifying specific action tar- 
gets and strategies, and finally beginning advocacy activi- 
ties - whether case or class -r appears to require at least 
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one year cmd in several cases, fifteen to eighteen months. 
Indeed, a more hasty approach to accomplishing this seems 
to resxilt in a variety^ problems (inadequately trained, 
staff, lack of community support, ihappropriately identified 
and selected targets and strategies). Time aind deliberation 
appear essential where new prograjn models and innovative 
service strategies are being developed and provided. 

Evaluation of project initiation sis particiilarly 
sensitive because it is in this phase that a somewhat sym- . 
biotic relationship between pro^ecflnonitors and the projects, 
as entities, begins to emerge. In effect^ project monitors 
do not watch for critiisal milestones and draw necessary 
conclusions. Instead, they often seem to develop a vested 
interest in the continuity of projects, and a project 
may be refunded even though it would seem obvious to any 
independent observer that it is in grave difficulty (perhaps 
it is easier both for project officers and for projects to 
get funds to continue an existing project than to fund a 
new one). Yet, in reality, in real experiments, failure - 
and knowing what leads to failure - is as important as suc- 
cess. Failure must therefore be faced and labeled as such. 
As G. K. Chesterton said, "If a thing is worth doing, it is 

worth doing badly." If that were kept in mind, project 

\ 

monitors might not need to support a project's tontlnuity, 
regardless of performance, defensively insisting that it 
is really a "success." 
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Implementation Capacity as a Primary Focus for Evaluation 



ject development and completing It takes far more time than 
was previously recognized. Only three of the projects In 
this sample of twftaty-three reached this point and they 
tended to be the oldest In the sample. For these, success- 
ful Implementation seemed to be predicated on successful 
planning and Initiation, * although one project that seemed 



In difficulty In the Initiation p hase began moving towards 
successful implementation by substantially redesigning its 
/program. 

Two issues emerged during review of this phase 
of project development: The first is that projects may be 
evaluated as successfully implemented at one point in time and 
then retrogress. Several variables may account for this. 



and will be discussed in greater detail subsequently. The 
second is the importance of seeking out and identifying crl 



project. In fact, the very nature of the study made this an 
implicit if inadvertent and unanticipated focus. Thus, the 
study has highlighted an evaluative area which has received 
little attention prev3?ously. 



Again, attaining the implementation stage of pro- 




teria for evaluating the Implementation capacity of a new 



In Social Policy and Analysis , Walter Williams com- 



ment^is^ that: 



At the heart of the problem of moving from a decision 
to a ^program in the field are two complex factors: 
prograil\, specification and implementation capacity. The 
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first concerns how well specified a proposal need- 
ing implementation is. Does a decision to start a 
new program in the field rest on a soiind blueprint 
for action derived from extensive study and testing 
on a small scale, or from a vaguely delineated desire 
to solve a problem? The second factor concerns an 
agency's capability to implement a decision once it 
is made. Does the agency have the personnel and 
organization capability needed to carry out the pro- 
gram a,s specified in the design? When a program does 
poorly in the field, it is almost impossible to dis- 
entangle the unique negative contribution of the de- 
sign specification underlying the decision from the 
subsequent implementation. But together these two 
problems loom as the biggest substantive (as opposed 
to purely monetary or political) hurdles to better 
^social programs;! 

He continues b/ stating that over a wide range of social, 
action programs 

...the experience seems to emphasize, over and over 
again, the difficulty of bridging the gap between 
programs so conceived and workable field operations. 
And a critical missing link is empirical and cr 



tual informati 



oncep- 



ormatlon directly addressing questions of 

_ program design, organization, and operation .^ 

He concludes, a few pages later b^ stating that this prob- 
lem of implementation has been ignored by both project 
directors andTdecision makers as a critical factor in eval- 
uation of effect and effectiveness; that outcome and im- 
pact evaluation criteria must be based on an understanding 
of implementation capacity; that the assessment of this 
capacity is basic to Iny decisions and recommendations rer 
garding programs; and Vhat "the capacity to implement pro- 
grams is a legl^timate and challenging area, the irtiportance 



Williams, social Policy Research , p. 4. 

2 

Ibid., pp.. 4-5 (emphasis author's). 
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Of which in terms of program operations should make it a 
high-priority target for policy research."^ 

This study was designed to provide empirical and 
conceptual information about child advocacy projects, addres- 
sing questions of p^Je^t design, organization and operations. 
InitiallV^ it was assumed that this would permit development 
of criteria fox outcome evaluation. It did not, for rea- 
sons mentioned previously. Instead, however , without con- 
scious intent or plan, what emerged as a major focus of the 
study is this problem of implementation capacity: the iden- 
tification of those factors which permit a project to bring 
Iqgether human and other resources in a cohesive organizational 
ixnit and motivate them in sudi a way as to carry out the pro- 
ject's stated objectives. This is what is involved ifi the 
successful planning and initiation of a project. It is for 
the purpbse'of evaluating implementation capacity that the 
identification of criteria for evalxiating each developmental 
phase becomes so. important. ''The xinique problem for child 
advocacy projects' is that even when one identifies these cri- 
teria and demonstrates what might be termed program competence 
we are still faced wit^i a subsequent and, at least for this 
researcher, an xinforeseen problem. That is, having Identified 
projects rated high on Implementation capacity (high In 
planning and Initiation) or even having Identified projects 
that have been successfiilly implemented, then whit? 

^ Ibld . , p. 16. 
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In the course of testing the initial evaluation 
instrument, certain projects v/ere visited which earlier 
appeared to be implementing their programs as planned. 
Yet, six to eight months later .the nature of the program 
had changed sharply, and in one instance the project 
seemed on the verge of collapse. Although, as indicated 
in Chapter VII, reasons for all these changes seemed ^ 
readily apparent (e.g., changed leadership; changed poli- 
tical^ climate; changed or lost funding), the problem re- 
mains. Is this a reflectii^n of inadequacies in the cri- 
teria ^or evaluating a project *s implementation status, 
or does it imply, rather, something else about these pro- 
Jects? 

The Risks of Social Experimentation 

In effect, the difficulty of fixing or stabilizing 
innovative programs underscores one of the major risks in 
social experimentation generally. In fact, it may be this 
instability that i? so critical in inhibiting the devfelop- 
ment of measures for outcome, or impact evaluation. The 
very nature of these projects innovative, experimental - 
implies great fluidity in programming and a high risk of 
failure. Projects evolve in real life and thus respond to 
the real world around them. 

Leaders may leave and the project may lose its 
,sense of direction. The kinds of people who get involved 
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In initlatine such projects tend to drift to other projects, 
organizations, ideas, for a variety of reasons. Sometimes 
they leave because the project has not worked. 

Many directors of child advocacy projects begaji with 
great enthusiasm and left after two years of frustration.. 
One problem is the unrealistic expectations most directors 
' have for project development. Perhaps the findings of this 
study may help to set more realistic standards and expecta- 
Hions and provide a more viable framework for future project 
developers. Others leave because the project has worked, the 
initial task has been accomplished, and they are bored and 
seek out a new challenge. Sometimes, their success stimu- 
lates other offers, with more impo-rtant or rewarding oppor- 
tunities, and so they leave. . As was discussed .lA the last 
chapter, regardless of the type of project, program or or- 
ganization, the departure of project leadoship has negative 
consequences. It may leave the project temporarily rudder- 
" ' ^S^s; without control and direction, it regresses. Or the 
project may change direction sharply, again, usually for th^ 
worse. 

In^^ne apparently successful project, loss of the^^ 
* project director and assistant director not only left the 
project without^ leadership, bu^ it eliminated the project's 
main contact with the community. Thus, another potential 
risk is that community participation may be eliminated be- 
cause the project loses its indigenous staff or community 
board members move away and the project has no other sustained 
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bridge to the community. 

A third risk of social experimentation Is that the 
political climate may change^ leading to loss of funding/^ 
Increased community resistance to a particular type of pro- 
ject, decreased tolerance for conflict or unwillingness on 
the part of project administration to take risks. The Nixon 
administration's attitude towards social programming gen*^ 
erally affected many communities visited in the course of ^ 
the field test, several mpnths after the 197? election and 
after newly elected local officials took office. The con- 

cept of active intervention - changing established agencies, 

> 

organizations and institutions - was viewed with far less 
toil^erance than one year earlier. Directors seemed far more 
fearful of conflict or aggressive action than earlier. 

Fourth, as indicated earlier, money ^=^uiiding - plays 
an enormously Important role in the development of these 
projects. Although the implicit premise on which research 
and demonstration projects receive federal funding is that 
such funding will be continued if the project is"^ proved sue- 
cessfxil, in fact this is often noy true. Success may be 
meaningless, as indicated above, if the political climate 
changes. Inevitably, the loss of funding that may occur 
under such circumstances (or the changed source of funding), 
plays an important role in project continuity or the stability 
of programming. Thus, what appeared to be the most success- 
fxil of all the projects studied closed when it lost its fund- 
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ins as a result of the eevere cutbacks in OEO prosrams. A 
sdcpnd project, v{hlch had also appeared to be on the way 
to successful 'imp*Lemen*atlon, <v;as- informed Its fundirig would 
end 4.n; Fiscal Year *7.4, Seeking out new financing to stay 
alive, it obtained assurfeince of state mental health funds if 
the project would redefine its objectives and strategies, 
Currently, it appears to be changing from an active advocacy 
projiect to a .traditional direct service, counseling and 
guidance, project vrlth §ome^ provision of information and re- 
ferral services. Its advocacy ^ctivit4.es are being phased ' 
out 3^ although the label remains. 

Since advocacy implies constant responsiveness to 
nejeds, and^need« change, advocacy projects must be fluid. 
As organizations'^ they must coni&tantly address tho, prob- 
lem of self -renewal. For example, a project' may initially 
f ocUs, on advocacy to achieve one objective. At the communi- 
ty level, as we have indicated/ this^^ends to be a limited 
Objective, Once it is achieved, a portion of the v/hole 
developmental process^ begins again - nev; objectives jnust be 
specified and new strategies selected and applied. In part, 
success for an advocacy project requires constant risk, In- 
dee^d, the most "successful are always cliff-hangers, remaining 
on the verge of trying something new, and thus risking fail- 
^e. If projects become fearful, fixed and rigid, they lose 
this primary characteristic, and then by defiriition, ^they 
are failures. 
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o^e Thoughts about Outcome and Impact Criteria 

Unfortunately, little xiata obtained In this study 
' support any clear concept of what criteria for advocacy 
outcome and ln5)act measures mljght be. Pew projecti^ were 
far enough along to have Identified such' criteria for 
themselves, and ev^n e^mong these, change and regression were 
apparent by the end of the study. 

Some "project-specific" criteria emerged from re- 
view of Individual, specialized advocacy projects, however. 
For example, a student advocacy project conceftti*atlng on a 
single target, such as^ a. school system, might epiploy such' 
' measures as: new courses add6d to the school curriculum; 
Increased participation of students and/or parents In making 
school policy; development of formal grievance procedures; 
'' Increased school expenditures; revised rules for school sus- 
pension; court decisions supporting students' rights to due 
process of law. 

Advocacy project^ addressing the juvenile justice sys- 
tem might use such measures eis: reduced rates of institutional- 
ization; reduced incidence^of remand; increased numbers of 
alternative yoiith services. Possible measures for health 
'advocacy projects might include: extended clinic hours; re- 
duced waiting time; improved physical access; increased rates 
of service Use. ^> 

Although difficult, it is obviously simpler to develop 
measures for specialized projects than it is to invent com- 
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mon measures for evaluating child advocacy projects generally.. 
General "categories'^ for such measures could probably be 
separated into measures for assessing effective case advocacy 
and measures for .assessing effective class advocacy. For 
the former^ these might include: the number and type of ^ser- 
vices provided where none previously existed; the number and 
type of services obtatj^d after initial refusal or denial of 
service; the number of legal rights and entitlements ob- 
tained; individual legal actions taken and won. For class 
advocacy: ^criteria might include the relative number of changes 
in specified policies^ administrative procedures personnel, 
rules, budgets, laws, legal class actions. 

In employing such measures ^ it woul4 seem essential 
that criterte so i^ntif led would be assigned differential 
weighting. For example, advocacy actions resulting in the 
elimination of a state-wide law permitting corpor^ punish- 
ment in a schoo3£> system employing such punishment frequently 
might receive a very different weighting than changing a rule 
regarding use , of a school gymnasim on weekends by senior high 
school students. .Such weighting would have to reflect both 
quantitative impact (the numbers of children and/or families 
affected) as well as qualitative impact (some judgement as to 
the importance of the change). 

CHILD ADVOCACY: A FINAL LOOK 

V 

As mentioned In Chapter I, shortly after beginning 
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the 1971-72 study of childSadvocacy, we concluded that child 
advocacy was a fad, the label merely a funding gimmick, and 
that it covered a mass of disparate and confused functions 
and activities. In time^^we changed our perspective, iden- 
tified what seemed to be a new phenomenon, with some under- 
lying coherence and cohesiveness . Based on what ve saw and 
heard, we defined a concept of child advocacy. Two years 
have passed since then. The concept remains exciting, rele- 
vant, and functional. "Child Advocacy" seems to have stim- 
ulated a wide range of activities, and some people are con- 
tinuing to do exciting things. But as a programmatic pheno- 
menon, on the community level, at least, child iSLdvocacy seems 
to be short-lived. Projects that appeared failures initially 
still seem so; projects that appeared successful have either 
lost their funding and closed, changed their source of 
financial support and relinquished their advocacy character 
to adapt to other funding agency guidelines, or lost their 
leadership and thus their mission. The weaker projects have 
turned to traditional direct service provision, if - or per- 
haps in order to be - funded. Stronger ones, if still funded 
and moving forward, are stressing provision of access service?, 
with case advocacy as one component of their total program. 
Certainly among the projects included in this study, advocacy 
seems diluted or increasingly non-existent. 

Yet the need /or advocacy continues. What has been 
termed a community conscience is essential if children are to 
be protected against inadequate laws or unresponsive ser- 
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vices and institutions. Advocacy projects function as 
v/atchdo^s, monitors, regulators or what Ralph Nader tias 
termed ''whistle blowers, ""'"with regard to other systems. 
In effect, one function of an advocacy project is to pro- 
vide a mechanism for ensuring quality control in service 
delivery^ If S^is is defined as an essential social 
need, the question becomes, how does one de9ide orl jbhe ^^^^.^^ 
adequacy of the dollar ' investment in such a system? How ^ 
much money should be invested in analyzing the potential 
impact of new legislation on children and their families? 
How could one evalimte the effectiveness of such projects? 

When a business decides to establish a quality 
control system, its decision' is based on a whole series of 
variables including the dollar loss - and the number of 
complaints generated by poor quality of the goods produced. 
True, it may not be a worthvrhile expenditure to eliminate 
all complaints, but a costA»enefit analysis is possible. As 
yet, our society has not even defined failure to take up 
service, benefits^ or entitlements, as a "cost." In fact, 
in certain segments of our society this non-use 16 defined 
in reverse terms, as benefit - the lower the take-up, the 
lo\*er the cost. Similarly, society has not defined "complaints" 
about service provision and unresponsiveness (pj^or quality 
services) as a "cost." pbvlou^ly j»/hen one segpient of • socl- 

^Ralph Nader, Peter Petkas, and Kate Blackwell, eds.. 
Whistle Blqv/ing (New York: Bantam Books, 1972). 
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ety defines "cost" as what another defines as "benefit," 
neither costA>enefit studies nor precise "hard" evaluation 
can be satisfactorily implemented, 

James Q, Wil^|^ commenting on the problems and 



difficulties of evaluating the impact of broad-aim, social, 

B|*rt^ pi 



or what he te|*rti^ public policy programs^ suggests two 
general lawsi/ ^ 



:v ' >FJRST M^: All^^ policy interventions in social problems 
' ^ p^rbdUce tl^e\y^^^ • if the research is carried 

6ut^ >5^^1;hQs^ /^^ the policy or their friends, 

^%^^l^hA^\ No'^poM'cy intervention in social problems 
produces the iritended effect ^ if the research is carried 
out by ilfcfependent third parties, especially those skep- 
\ " tical ofHhe policy, 

^ Wilson' thus suggests the inevitable frustration inherent in 
trying to make policy decisions based on precise knowledge 
about program results when value elements loom large in re- 
gard to the criteria. Yet, he concludes by stating that re- 
^ardless of the fact that making a policy decision to pro- 
ceed with a particular type of program is a value decision, 
attempts at improving the bases for evaluative ^studies are 
^ essential. Once social choices are made, they should and* 
can be made visible a^id gbal measures sought. 

We now have a picture of child advocacy at the^.4^- 
, munity level and we know something ibout what precludes suc- 
cessful implementation of advocacy activities. However, 
having described what goes on, does not mean ^at there cannot 

^ ■'■James Q, Wilson, "On Pettlgrew and Armor: and 
Afterword," The Public Interest , No, 30, Winter, 1973, p. 133 
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be change or improvement; because projects develop the 
way they do, does not mean that the whole process is 
inevitable. Quite the contrary. Although most of these 
projects have had a large number of problems, no systematic 
d^a or experience vras available to guide or assist them 
prior to this study.. By identifying what must be accom- ' 
plished in setting up new projects, and what the potential 
problems are, this study has tried to provide such infor- 
mation. Hope Ailly,^Xore warned is forearmed. 

However, we know much less about what facilitates 
or assures successful implementation of advocacy activities 
Clearly, further study is needed of "successful" advocacy 
projects when they are identified. Nor do we know what the 
effect of advocacy - of these actions taken by advocacy pro 
Jects - is, on the agencies, institutions, organizations, 
groups, it tries to change, or what its impact is on the 
community at largeT^l though advocacy undoubtedly will 
continue In k myriad of ways - as part of individual or 
orgcmizatlonal roles - we are not even sure If it can, will 
or should survive, as an organized entity or phenomenon. 
The study of child advocacy, as a continuing and sustained 
organizational phenomenon - how advocacy can best be 
implemented and what its effects and effectiveness may be- 
remains a research challenge for the future. 
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A. COMMUNITY-BASED CHILD ADVOCACY PROJECTS 
.PARTICIPATING IN STUDY 



1. Alemada County Mental Health Association* 
Tri-City Child Advocacy Project 

1610 Harrison Street 
Oakland, California 946l2 ' 

2. Center for the Study of Student Citizenship, 
Rights and Responsibilities 

1145 Germantown Street 
Dayton, Ohio 454o8 

3. Child Advocacy Group* 
Denver General Hospital 
7th and Cherokee 
Denver, Colorado 80204 

Child Advocacy System Project* 
Learning Institute of North Carolina 
1006 Lamond Avenue 
Durham, North Carolina 27701 

5. Citizen Advocacy Prograun 
55 High Street 

Mt. Holly, New Jersey 08060 

6. East Nashville-Caldwell 
Child Advocacy Project* 
Meridian and Berry Streets 
Nashville, Tennessee 

7. 'Family Development Center 

Family Service Agency of San Francisco 
3555 Army street 

San Francisco, California 94llO 

8. Holly Park Child Advocacy Demonstration Project 
2907 So. Van As salt Court 

Seattle, Washington 98II8 



Child Advocacy Projects for which case studies were 
done in th^earlier study (1971-72). 
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^ 9. liou^h Parent and Child Center 

Advococy Co.npoiicnt 
7724. Lexington Avenue 
Cleveland, Ohio ^l4l03 

10. Institute for Child Advocacy'* 
Central City Cormaunity Health Center 
4305 South Broadv/ay 
Los Angeles, California 90037 

11. Martin Luther King, Jr. 
Parent and Child Advocacy Center 
560 North Broadway 
Baltimore, Maryland 21205 

12. Mexican American Neighborhood 
Civic Organization 
Child Advocacy Project 
1506 S..W. 19th Street 
San Antonio, • Texas 78207 

13. Parent Child Center 
Child Advocacy Program* ' [ 
188 Geneva Avenue 

Dorchester, Massachusetts 02121 

14. Philadelphia Urban League 
Child Advocacy Project 
644 IJorth 52nd Street 
Philadelphia, Pennsylvania 19131 

15. Queens Lay Advocate Service 

149-05 79th Avenue • 
Flushing, Nev; York II367 

16. Social Advocates for Youth* Social Advocates for Youth 
315 Montgomery Street, Suite #lOl4 2l8 "E" Street 

San Francisco, California 94l04 Santa Rosa, California 



17. Social Advocates for Youth 
5973 Encina 

Goleta^ California 93017 

l3. South End Family Ser-vlce Agency 
200. iCast 29th Street 
Little Rock, -Arkansas 72206 

^ . e 

19. V/cst Nashville Youth Service"* 
3420 Richards Street 
I'lashville, Tennessee -37215 



95404 
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20. Western Carolina Center* 
Morganton, North Carolina 

21. Working Together for Children 
Child Advocacy Program 

Prince George's County Public Schools 
Ut)pejr Marlboro, Maryland 20870 

22. Youth Advocacy Program of St. Joseph County* 
509 West Washington Street 

South Bend, Indiana 

23. Youth Services Agency 

392-13th Avenue , ^ 

Newark, New Jersey O7IO3 
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B. LETTER EXPLAININ G STUDY TO PROJECT DIRECTORS 

' ' ' y ■ - — - - — " ■ ■ — ■ -= 

The Columbia University ScIuxj! of Social Work | New )h,l:, N. Y. iOQ:^5 

Child Ad\ {>w m y Rosearc^h Pro,t; t i^'^lt \*4i \ \ ::t\ C^*roul 

October 6, 1972 



Dear 

We have just completed a national s\irvcy of child advocacy t)rograms. 
Publication of our mcnosraph, entitled CHILD ADVOCACY: A MTIOIiAL BilSELII\^ 
STUDY, is Gcheduled for IJovenbe^r,, 1972 and distribution will follow shortly 
thereafter. The report vill include our findings and an overall d-scription 
and analysis of ciurrent developments in the field. Vfe hope you will find 
it of interest. You, of course, vill receive an early copy. Keedless to 
cay, we are most ^appreciative of your past cooperation. 

We axe continuing our study of child advocacy, again under the auspices 
of the Office of Child Developaient . This year's study vill , concentrate on 
two facets of ccranunity-based child advocacy programs: ll Program Da»elopments 
(how child advocacy programs become operational; what kinds "Oj cri-^ia can ' 
be employed for purposes^ of evaluation); and 2) Practicc^Methods and Techniques 
(in particular, what workers do when they function as child advocates.- 

The first phase of our study on program development yivolves identifying 
the stages and steps by which programs become operational. We are interested . 
in such questions as: hov? and by whom a program is developed; When, how and 
by whom staff, board and constituencies are selected; targets identified; 
intcrventive strategies developed; V7hat kinds of problems arise during the 
first year following funding ajtid hov; are' they overcome? Ovir purpose here 
is to arrive at some concept of normal developmenta]. patterns for 
cammunity-based child advocacy programs in order to develop guidelines 
for other newly established programs. In addition we hope to provide a 
framework within v;hich v/e con begin to develop criteria for evaluation 
purposes. 

Your program is one of those we very much hope to include in o\ir new 
study. Participation in this study would require about one half day of 
agency time. I would want to interview those people most directly involved 
with the formulation of the program (who wrote the proposal if one was 
written; who initiated the program; who administered it initially as we 
as the current administrator.) I would also like to read any relevant 
material, saich as a proposal, minutes etc. 

I shall telephone you in about a week, hoping to arrange a convenient 
time for my visit. Once again, I want to thank you for your cooperation. 
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Sheila B. Kamerman 
Project Director. 
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C. INTERVIEW GUIDE FOR PHASING-IN STUDY 



NAME OF PROGRAM 
ADDRESS 



TELEPHONE NUMBER 



DATE PROGRAiM W43 ESTABL;^HED 



DATE PROGRAM WAS FUNDED (if different from above^ 
NAME OF PRINCIPAL INVESTIGATOR 

; 



ADDRESS 



TELEPHONE NUI-IBER 



NAME OF DIRECTOR (if different from above) 
ADDRESS 



TELEPHONE NUMBER 



DATE FIRST EMPLOYED BY PROGRAM 



KEY PEOPLE IN GETTING PROGRAM GOING 



(Names, where located, can they he interviewed?) 



IS THE PROGRAM FULLY OPERATING NOW? 
CURRENT ANNUAL BUDGET ' 



SOURCE OF FUNDING (major) %_ 

erJc 



C r\ n q 

I' O * 



(other) % 
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PLANKING PRIOR TO INITIATION : 

WHAT (when, who, WHERE, WHY, HOW) STIMULATED THE DEVELOPMENT OF 
THE PROPOSAL OR PROGRAM? 

a) availability of new fwidsj b) recognized problem or need in 

the community; c) pressures from the community or^oth^r groups; 

d) decision of sponsor^^ng agency; e) individual initiatives; 

other influences 



WAS A FORMAL PROPOSAL DEVELOPED FOR THE PROGRAM? 

If so, is a copy available? 

Who was involved in preparing this proposal? 

If others besides the director, can they be interviewed? . 

How and Where? 
How long did it take for the proposal to be formulated? 
Was technical assistance provided by any other organization or 

individual? (OCD staff, NIMH/BEH^ staff , other HEW staff, 

professional proposal writer, etcl) 



IF NO FORMAL PROPOSAL WAS DEVELOPED, WAS THERE SOME OTHER. KIND 
OF FORMAL OR INFORMAL PLANNING PRIOR TO THE PROGRAM'S INITIATION? 

What was it? (memo, document, report) 
By Whom? 

V/hat was its nature? 
> How long did it take? 



FINANCING 

How were funds obtained for the program? (Who contacte'd whom> what^ 

was process) 
How long did it take to obtain ^funding? 
How are funds channelled into thf program? 
Did any problems arise regarding funding? 

If yesi what kinds, why, what happiened? 
Did the program change during the course of looking for funds? 

If ^so, how?^ 
Source of initial funding - 
Amount 

For hovJf long a period? 
V/as this the total budget? 

If nat, what was the source of additional funds and how much 

were they? 

How a,nd by whom is fiscal control exercised? 
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AUSPICES: 



What ari^ey? 

What is the nature of the relationship between program and "auspices? 
Has the auspice restricted or influenced the program in cmy way? 
If so, what etc* 



GOALS: 

What were you trying to""achieve? (goals and targets) 
Who decided these, when, by what means? (director alpne; 

in conjunction with others; what otl^erfe; sponsor, etc. 
Did other people have other objectives? 

(If fOy what were they?) ^ 



WHAT ELSE OCCURRED REGARDING .THE PROGRAM, BEFORE IT WAS ESTABLISHED? 

What was done? (staff identified, target area selected, constituency 

mobilized, goals selected) 
Did the plan chajige during this period? (problems, conflicts, and 
. how resolved?) How and Why? 



IF YOU WERf; PLANNING A PROGRAM AGAIN, WHAT KIND OF INFORMATION AND 
HELP WOULD YOU WANT? 
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INITIATION Plji^^E : 



WHAT WAS DONE ONCE FUNDING WAS OBTAINED? 
actions, etc.) " * 



(first activities. 



PHYSICAL PLANT: 

Does the program have pts own office? 
When was the site selected for the program? 
By whom? . I 

Reasons for selection? 



ORGANIZATIONAL STRUCTURE: 
Staff ; - ^ 

When was the director recruited and hired? ^ 
■ Who selected him, and by what means? 
Reasons for selection? 
How long did the process take? 
Mh^t was the director's Job initially? 
Is it the same now? 

.If not^ how has the role changed and why? 
Hov7 closa is the staffing pattern to the projected or 

intiended staffing pattern? - * . 

How many of the staff (and who) were aroxind .when the 

program was planned? 
How many ht a later point? When? 
How was staff recruited and hired? 

By whom and how? 

How long did tt take? 

Reasons for selection. 



(advisory or policy-making)? 



Boar4 

Is there a board^ What kind 
How was t;^e board selected? 
By whom and when? 

When did It first meet? ' ^ « 

How often .since then? 

What does it do? (illustrate some initial activity, 
^ activities,' changes over time and reasons why?) 



^ 7 



current 
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Contact ; 

How did people get to know about the program? When? 
Were you able to^ identify any aids to implementing the 

program? (organizations, groups, coalitions, influentials) 
, When? How were they involved? ^ 
Were there any unanticipated problems at that time?/ 

What were they, when, occurred, how Solved or why "^solved? 
Did the program undergo any chan&es du|*lng this period? 

If so, what, when, why and what happened?* \ • 



At the beginning how did you think you would accomplish your 
^objectives? (Publicity, negotiation, persuasion, confronta-^ 

tion, court action, organizing constituencies, lobbying; case 

or class or combination of both). \ 
Who decided on this? When?^^ Why? 
Have these changed since then? How? Why? 




Action Strategies and Action fargets ; 
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PROGRAM IMPLErffiOTATION ; 

What is the nature of your current program? 

Do you provide direct services ?' What kinds? \ 

If so, \vhat percentage of totai program* does this^ involve? 

When were these first provided? 

How many are served directly now? Initially? 

Have the types of services provided changed over time? 

If so, how, vrtien, and why? 
What proportion of program is devoted to your advocacy activities? 
What kinds of activities, \^hen were they first implemented and how? 
What portion of your program is devoted to organizational maintenance? 

VJhat kinds? (administration, research, fund raising, mobilizing 

constituencies, etc.) 
Are there activities that have not been included above? 

Kinds, etc. 

liJho makes most of the decisions in the program? 
By what means? 

Illustrations of some of the more important ones currently. 
Do you consider the prograjn to be fully operational? 

If not, x^hat still has to be done? 

When will that happen? 
Has the program changed since its inception? 

If ^o, in what Way and why? 
Have the goals chsjiged? 

How, when, and why? 
What have been the major problems faced by the program? 

Were they solved? TThen? How? vfitnticipated or unanticipated? 
What have been the major failures ^f the program? 
Has the program achieved the gpals^ initially specified? 

If not, what are the differences and why have they occurred? 
If a group in a neighboring community came to you for advice about 

how to set up a child advocacy program like yours, what would 

you tell them? ^ " 

If yqu were evaluating a child advocacy program, what criteria would 

you use to determine how effective a prograan is? 

How would you apply these criteria to your program? 
If you had it to do again, what would you do differently? 



CS'V7 7 
^ 



ERIC 



270 

V23/r3 



D. AN INSTRUMtolT FOR DIFlTfiKgMTIAL EVALUATION OF 
COMMUNITY-BASED CHILD ADVOCACY PROJECTS 



The following instrument^ which is be tested for use 
in evaluation of community-based child advocacy projects. In- 
volves three classification schemes: 

1. Determination of the project's developmental stage 
(planning, initiation, impLjementation) at the time 
studied. Each project wili be classified at its 
most advanced stage of development. 

2. Classification of projects as advocacy and non-advocacy 
projects. Non-a*\rocacy projects will be labeled as 
such in the phase in which their non-advocacy is 
identified, and then eliminated from further study. 

3. Identification of inditia of possible success or nori- 
sucQess in the project's cxirrent stage of development. 

For present purposes^ this instrument will include the 
following: Ini^tructions for the rater (how to use the instrument; 
which material to get and where ^t may be ol?tained)j inditia for 
each phase and instructions regarding weighting, where relevant; 
the rating Scales themselves. When the actual instrument is 
developed for field use, these may be separated. ^ 
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INSTRUt4EMT FOR DIFFEREIfTIAL EVALUATION OF COMMUNITY-BASED 
CHILD ADVOCACY PROJECTS 



Dates of Site Visit 



P 



Neane of Field Representative_ 



Name of Project 
Address 



Te lephone NumDer 



Name of Project Director 
Date First EaQ>loyed " 



Date of Funding Authorization for Project 

Date when budget period began 

Annual Budget 
Source of Func[i 



Name of Auspice or Sponsoring Agency 
Address: 



Staff 



Category Nmber date hired date left date replaced 



Administrative 
Supervl s or y 
Line 



Specialist (describe) 
Consultant (describe;' 

Secretarial 

Other ( specify) 
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I. CIASSIFICATIOW OF PROJECT INTO DEVELOPMENTAL STAQES 

A. Planning ; The stage that begins vrtien some Individual , 
group or or^uilzatlon begins to think about and de- 
sign a child advocacy project, and ends with the pre- 
paration of a foiroal proposal or memorandm, planning 
document, or a decision Indicating th£ta child advo- 
cacy project will be established. 

If anj^ of the Indicated activities characterizes a 
project (and no more than one activity of the Initiation 
phase has as yet been completed) It Is to be' classified 
In the planning phase. 



SOimCE OF DATA ; Written proposal (If one exists) and Interview 

with planner, prlnclpiQ Investigator or pro- 
posal writer. 

1. Determination and documentation of a need or problem 
In the coramxmlty. Circle all Items below that apply 
and check "Y" If ANY apply; 

a. An Individual, group, or organization gets an 
Idea for establishing a child advocacy project 
and decides to do something about It. 

b. A problem or need related to children Is 
Identified In the community. 

c. The meaning and In^llcatlons of child advocacy 
are explored. 

^d. A leader, leadership group, or planner of child 
, advocacy project Is Identified. 



2. Delineation of a ^eclflc target community 
and a target population. 



Y 

N^ 



' Y 

N^ 
> NA~ A 




c 



n ^ <^ 
\i u 



0 
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3* Participation in planning the project, of Y 
a wide range of interest groups in the 

community* Check "Y" if three or more of NA_ 
the following are circled. 

4 

a. Participation and involvement of consumers. 

b. Participation and involvement of influential 
lay people. 

c. Participation and involvement of experts. 

d. Participation and involvement of relevant 
organizations . 

k. Specification of objectives or of goals. Y 

. IT" 

5. Selection of targets for intervention, levels Y 

of intervention and interventive methods and r 

* techniques. Check "Y" if at least one of the NA — 
following applies (and circle item); 

a. One or more targets for change are identified. 

b. Strategies for achieving objectives are identi- 
fied or designed.'- 

6. Organizational structure is designed. Y 

7. Selection of an auspice (for a new project) Y 

* or obtaining the support of the existing 
administrative structure for a new^ program NA 
con^onent. 

8. Hiring of an expert to prepare a proposal. Y 

NA^;^ 

9. Preparation of a proposal or memorandxim by a Y 
leader or leadership group. 



NA 
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10. Searching for funds, caieck ''Y" if one or more of Y 
the following apply (and circle applicable items) : 



NA 



a. Formal and/or informal contacts with funding 
agencies. 

b. Formal submission of proposal to a funding 
agency. 

c. Informal submission of memorandum to higher 
administration. 



B. Initiation ; A stage that begins when a I^roJee|^vlseceives 
funding and/or a specific decision is made to establish 
the project. It ends when the organization is structured, 
the program developed (action targets and strategies iden- 
tified)j a constituency mobilized and case or class advo- 
cacy is first provided on a regular basis. 

If any two or more of the following activities 
characterize the project (and activities #1 and #2 of the 
implementation phase do not characterize the project) it 
is to be classified in the initiation phase. 

SOURCE OF DATA ; Interviews with Project Director ad Principal 

Investigator (Indicate ^diich was source of data). 
Written Progress Reports. ^ , * 

1. Initiation process is begun. Check *'Y" if any of Y 
the following apply (and circle applicable items); 



a. Funding is obtained. 

b. Admini^rative approval is. obtained. 

c. A deAsion is made to establish a project without 
formal funding. 

ERIC 



NA 
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organizational structiire Is established. 
Check "Y" If a or b apply: 

I 

\ 

a. For projects depending upon the use of 
paid staff, administrative, supervisory 
and line staff are recruited and hired, 

b. For projects depending upon the use of 
volunteer staff, volunteers are recruited 
and hired. 

The organizational mission is integrated into 
the project. Check "Y" only if a krvl b apply: 



a. Directors Or project leaders are selected 
from among those vriio had participated in 
planning the project. 

b. Staff is trained. 

Sanction and legitimacy for the piqfect is ob- 
tained by the Identification, organization, €uid 
mobilization of a constituency. Check "Y" if 
four or more of the following are circled: 

a. Indigenous staff are recruited and hired. 

b. Membership on the board is defined* to include 
consumers, experts, influential lay people, 
organizational representatives, others (specify) 

I. 

c. Consumers participate in developing the program. 

d. Experts participate in develqping^ the program. 

e. Other organizations participate in developing 
the program. 

f. Others (specify) participate in developing the 
progz*am . 
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5. Specification of goals. In particular first tar- Y 

gets for Intervention and first Interventlve N 
strategies. Check "Y" only If all apply: m~2 

a. Clientele Contacted. 

b. Referral, Sources Contacted. 
• c. Target(s)' Contacted. 

d. Project Publicized. 

6. Beginning provision of services. Check "Y" if any Y 
of the following apply (and circle applicable iFems ) : 



a. Direct servlc'fes are provided (counsaling, tutoring, 
day care, homem^er) 

b. Access services are provided (Information, referral, 
follow-up, brokerage). 

c. A survey or other form of information gathering 
is begun. 

d. Case advocacy is provided. (case advocacy is 
defined; obtaining, assuring, changing ahd/or im- 
proving services, benefits, rights, attention. to 
a specific child, children or feunlly) 

e. Clecss advocacy is provide^. ( Class advocacy is de- 
fined as obtaining, assuring, changing and/or 
improving services, benefits, or rights or attention 
for groups or classes of children and/or thelV 
families; 

C. Inrplementatioq ; The Implementation phase begins when case 
or class advocacy is first provided and exi^^ ^hen projects 
are fully operational, that is, when advocacy activities 
represent a major portion of the program and a majojr por- 
tion of staff time and objectives are defined in measurable 
terms. If Items #1 6r #2 plus at least one other of the 
following activities characterize the project, it is in 

the implementation phase. 

ERIC I u.o4 
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gOURCE OF DATA : Interviev/s with Principal Investigator and 

Project Director. (Indicate which of these 
provided data if this varies) Written 
Progress Reports. 

1. Regvilar and frequent provisions of case advocacy. Y 
(See above for definition) At least one case 
advocacy action per week for six months. NA 

2. Regular and frequent provision of class advocacy.. Y 

(See above fdr definition) At least one glass ^ N 

advocacy activity per month for six months. MA 

3. The sanction for advocacy is strengthened and Y 

' expanded. Check "Y" if either of the following N 

applies (and circle applicable item) : NA 

a. Coalitions are formed with other organizations 
and groups. 

b. Continued participation of consumers and experts 
in program and policy development. 

4. Effective and efficient use of project energy. Check Y 
"Y" if either of the following applies (and circle 
applicable item) . NA 

a. Project concentrates primarily on the provision 
of*-advocacy activities. 

b. Project has limited the number and dispersion of 
targets addressed and strategies employed. (Indicate 
number and category of targe t ) 

5. Continued, but revised and refined, training of Y 
staff. (Indicate date of ' most recent training program: 
_3 NA_ 

6. Identification, development and use of several de- Y 

vices to ensure corisimier cgid community accoiintabllity. n 

Check "Y" if two or more of the following apply (and NA 

t> circle applicable items): 

a. Increased participation of board in making 
policy for project (when board is representa- 
tive of consumers in community) . 

b. Regular and active participation of board (at least 
once a month) . 

CD?r" c. Consumer Involvement in evaluation of project's 

SiM^ achievements. 0 0§85 
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7. Beginning efforts at project replication. Y 

NA 

8. Specificity of goals and objectives In measurable Y 
terms . N' 

9. Documentation of achievements. Y 

NA 



OVER-ALL CLASSIFICATION OF PROJECT BY STAGE : 

This project Is now In the: Planning Stage, 

Initiation Stage, 

Implementation Stage, 
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II. CIASSIFICATION OF PROJ^ICT AS ADVOCACY OR NON-ADVOCACY 

A. For pro.jects only at the planning stage '^use the following 
criteria: - ' 

SOURCES FOR DATA ARE ; A written proposal, memorandxim, or 

other planning document and cui Interview 
with the principal Investigator, planner, 
project developer or project director. 

# 

1. No use of the term "child" or "family advocacy". Y 

N 

r 

2. Use of one of the above terms but no definition of it. Y 

IT" 

3* Inappropriate or Incorrect use of one of the > 

terms. For example: to describe traditional N 

service roles or direct services such as NA 
counseling, child care, child protective ser- 
vices. This is in contrast to appropriate use of 
the term advocacy to mean: active intervention on 
behalf of children in relation to those services 
and institutions which inqpinge on their lives. 

4. No objectives specified related to child advocacy. Y 
(i.e. above definition). IT^ 

NA~ 

5. No indication that any of the planners defined tYit Y 
project ?LS a child advocacy project. 

NA 



RATING: If two or more "Y"s" are characteristic of the planning 
phase, project was not planned as a child advocacy 
project. 

Project was planned as a child advocacy project. • Y 

m 
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B. For Projects at the Initiation Phase ^ Use the Following 
Criteria: 

~ s ■ ■ 

SOURCE OF DATA ; Interview with the project director. 

1. Project director Ignorant of the meaning of child Y 

-advocacy or Its relevance for the project, N 

^ . NA 

2. Part of the program designed around child - Y 
advocacy Is eliminated. For example, ellmlna- N ' 
tlon of specific advocacy training programs; ^ ' NA 
elimination of objectives related to child ' -"^ 
advocacy, 

3. No spe.clal training for advocate staff and no Y 
specified advocacy objectives., N' 

■ NA ' 



RATING: If any of the above are checked "Yes" , project was 
not Initiated as a child advocacy project, 

•Project was Initiated as a child advocacy project, Y 

Other( specify) 



7 
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III. RATING OF PROJECT AT CURRENT STAGE -OF DEVELOPtffiNT 
A. f^or Projects only at the planning stage ^ use the 
' following criteria ; 

. SOURCE OF DATA ; Interviews ^ with planner or principal 

investigator; separate and additional 
interview with project director (if 
possible) ^ 

1. Planning Iregun by other than indivldiial initiative ( s") . Y 
Check "y'^ if response is other than a: 



a. Someone heard about child advocacy or specific 
problems and decided to plaji a child advocacy 
pic^ject* 

b; Someone heard about funds being available for 
^hild advocacy projects' and. decided to plaji 
a pro^Ject.* 

c. An organization heard about child advocacy ajid 
decided to plan a project. 

d. An organization heard about funds being available 
NjPor child advocacy projects. and decided to plan 

a projects 

e. Other (describe) 

-r;-^ 



VALIDAT^lNG DATA FOR AjtoVE - 
When did planning first begin? Year Month 



Who planned project? (List names and positions of people at 
the time of planning who helped plan the project); 



NA 



— 1- 



When did planners first learn of funding agency's interest in 
, child advocacy projects? Year Mont h 

0 0 289 ^ • . 
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SOURCE OF DATA FOR #2 BEUStj/ ; Interviews wlth. planner of- prin- 
cipal Investigator: Separate In- 
terview with project ^llrector; 
Interview wltja staff members. 

2. Need for child advocacy not widely recognized or Y 
acdfepted in th? commimlty. Check "Y" for any of . N" 

the following responses:' a (2), b, or c: NA"" 

a. Planner first learned of child advocacy from: 
1^ Joint Commission Report 
2j Funding Mjency Notification 
Newspaper Article 

4) Other Practitioners \ 

5) Other Child Advoc&cy Prbjects 

6) Other ( specify) 



Project director first learned of child advocacy 
after being hired. 



Staff first learned of child advocac^ after being 
hired. 



SOURCE OF DATA FOR #3 BELOW : Reading of proposal and related \ 

dociaments; interviews with planner'' 
or principal investigator and 
project director. 

■ ^ 

3. Project poorly designed. Check '*Y" if amr two of the Y ^ 
following apply (and Circle applicable rEemsyT N n 



Community problems, needs ir objectives not 
clearly defined (any one of the following). ' 

1. Problem defined as'^lack'of resources but no 
specificity as to type of resource (e.g. pro- 
vision of services in ccMmnunity, special services 



r: 



or institutions, expanded services 

2. Problem defined as poor quality services but 
no specificity, (e.g. more staff) 

3. Problem defined as uxiresponsive service system 
but no specificity, (e.^. need for changed 
policies and procedureis 



NA 



4. Problem defined as low priority placed on children's 
needs but no clarity as to what needs should be 
highlighted. ' . 

ERJC " 5. other (specify) 
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T?i^rget population and target comiTiun4.ty are 
* fjG^[^ented S.nd 'dlsparat|^ and there are no 

. str&^^les specified to Overcome this problem 
during' the planning^ phase. '^l^ ' 

c. Child advocacy defined in general and diffuse 
terms. 

d. No conceptual framework developed. 

" I VA3;iDATING DATA FOR ^'d'^ ABOVE 

Please qircle whichever of the f oliov/lng characterize the 
pro^t and indicate basis for conclusion.. 

1) Internal advocacy - changing the system in vdiich the project 
*±8 based. . ' 

2) External advocacy - changing other systems that serve children 
and acting as spokesmen for child with regard to that system. 

3) Monitoring or regulating - ensuring that^' services provided are 
what service systems or institutions are supposed to provide. 

^) Lay advocacy 

5) Legal advocacy ^ 

6) Corabination^of lay and legal advocacy 
7.) Other (describe) 
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SOURCE OF DATA FOR #4 BELOW ; Interviews with the planner, project 

director and two of each of g^pups 
specified (consumers, lay people, 
*^ experts , organizations ) 

4. Failure to Involve all facets of the relevant Y 

• community In plfiuinlng for the child advocacy" , H 

project. Check "Y'' unless at least three of NA 

the following are circled ^ 

' a. Participation of consumers In planning. 



i VALIDATING DATA 

Who?: (pcunes cmd addresses of three consumers): 



How?: Membership In* planning group 

Meetings 

Workshops 

Surveys (personal, mall,^ telephone) 
Other (specify) [ 



/ 



When?: (Frequency of Involvement) 

^ Once during the planning phase 

Two to three times 

Four or more times 

What was the nature of this participation? (Briefly describe 
up to four activities of consumers): 
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b. Participation of influential lay people' in 

plannii^.^ . , \ 

} j ^ ^ » 

VALIDATING DATA 

Who?: (names and addresses of three influential lay people): 



How?: Membership in planning group 
Meetings 



Wolrkshops 

Surveys (personal, mail, telephone) 
Other (specify) . 



When?: (Frequency of Involvement) ' 

Once during the pleuining phase^^ 

Two to three times a 

Four or more times 

<^ ^ ■ " 

What \ms the nature of this participation? (Briefly describe 
up to four activities of influential lay people): 



erJc 



GO.?. 93 
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' ' c. Particlpatloa of experts In' plaxmin^s 

VALIDATING DATA 
Who?: a( names and addresses of tAree experts) 



How? : Membership' In planning group 

Meetings 

Worlc8hops_^ 

Surveys (persooial, mall, telephone) 



Other ( specify )j^ 



When?: (Frequency of Involvement) . ^ 

Once In the planning phase 

Two to three times . 

Fo\a* or more tlmes^ \ 

What 'was the nature of this participation? (Briefly describe up 
to four activities of experts) 



/ 



• ■ V23/73 

: -18- ' . ■ • ' 

i 

d. Participation of relevant organizations In 
planning. 

4". 

VAUDATING DATA 
Who?: (names addresses emd type of organization) ' . 



How?-: Representation through membership in planning group 

Meetings^ ^ 

Workshops 

Survey 



Other (specify) 



When?: (Frequency of Involvement) 

Once during the planning phasej . 

Tvjo to three tlmes^ * 

Fou^ or more times . 

V/hat was the nature of this participation? (Briefly* describe 
up to four Activities of relevant organizations) 



' • * <■ 

SOURCE OF DATA^FOrVs BELOW ; IntervietT with administrative dJbrector 

^f over-all project 02? agency and with 
immedite supervison of director of 
advocacy component. 

5* -(For new components of existing programs only) . Y 

Failure to obtain administrative support for hew* N"^ 
'component. Check "Y" if a*below is ^'no" : NA"" 



a. Did the project get administrative support and 
commitment for planning the new program com- 
ponent? : Y N • 



-19- 

SOURCE OF DATA FOR #6 BELOW ; Interview with plfthner, principal 

Investigator, or project directof 
if others are ,unavallable, 

6, Proposal prepared by someone not actively inyolved 
with the planning of the project. 



VALIDATING DATA 



Nature of relationship? ( s) of Indlv^diial who prepared proposal 
to project and other planners: 



One of planners 

Staff or board member of sponsoring agency 

Board member of over-all proJect_ 

Other (specify)- ~ 



c3 



J 
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III. RATING OP PROJECT AT CURRENT STAGE OP DBVELORffiNT 
• ^ ^ —7 

B. For/ projects at the Initiation phase, use the . ^ 

following criteria ; 

SOURCE^ OP DATA PGR #'s la and id BELQ>f ; Interviews- with project , 
~\ ~' /\ director and prlncipfiLl 

» \ investigator or planner. 

SOURCE OP DATA PGR #Xc BELOW ; Intervlew&--wlth principal inves- 

V tigator or planner, project director ^ 

and two representatives of each of 
' " "^He attove four groups . - 

SOURCE OP DATA FOR #ld BELOW ; Interviews with principal Investi- 
^ " gator, planner, project director and 

supervlsor(s) or advocates* ^ 

1. Project poorly structured. Check *'Y'* If either a,,bi Y 
or c below is circled; ' Wf 
^ ^ . NA 

a^. The project director was not involved in 
plajinlng the project. 

, . . 

b. There was no special training program for 

the advocate staff. \ 

c. Failure to involve all facets of the releviant 
^ ^/community. (Circle c uriless three out of the 

^ fQ^^ below are circleHyi \ 

meVs 



1) Consumers involved 



(See page 21 for VALIDATING DATA) 
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VALIDATINQ DATA F0R"III. -B. -1. -c . -1) 
Who?: (names and addresses of three consumers) 



29a 



How?: Community Meetings^ ^ 

Board Members * 

S^tf M^mber>a 

Otheri Consultant (specify) 

VJhen?: (Frequency of Involvement) 
Weekly 



r^onthly 

Thre^ tp f our „ times 
Once or Twice ^ 
Ongoing pArt of program 
ad hoc basis 



-What was the nature of ' consumer participation? (Illustrate) 



J ■ 
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\ ^ -22- : 
2) Experts Involved 

^ j 

VALIDATING DATA ' 
V/ho?^: (names and addr^^ses of . experts Involved) 



f 



Hovf? : Coramxinity Meetings^ 

Board 

Staff 

Consultants . 
Other (specify) 



When?: (Pr^quenc^ of Involvement) 

Weekly 

Monthly 

3-^ tim^~ 



1-2 times 5 

Ongoing part of profipram^ 



ad hoc basis 

What vras the natxire of expert participation? ' (Illustrate) 



/ 



3) Lay peopict^ involved 



VALIDATING DATA 
Who?:' (names and' addresses of lay people involved) 



How?: Meetings 
Board 



Volunteers 
Other (specify) 



IiJhen?: (Frequency pf Involvement): Same as Above 



O lat was the naturfe of lay participation? (illustrate): Same as Above 



V23/73 
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4)' othel:'~rfelev£int organisations 

VALIDATINp PATAU ' . 
Who?': (names of three agencies) 



How? : Ifif ormal Personal Contacts 

Representation on Board 

Meetings 

Workshops 

Formally established llnkagets (specify) 
Other (spelclfy) ' 



When?: (Frequency of Involvement) 

Weekly 

Monthly 

iSiree to four times ^ ^ , 

Once or' Twice 

Ongoing part of progra m / 
ad hoc basis 

What was the natvire of the participation of relevant organizations? 
(Illustrate types > of activities) ' 

— : ■■ : ^^7!-^ — 
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d.'No_further specification of objectives, 
^ ^ advocacy targets, advocacy strategies. 

VALIDATING DATA 
"What are the current objectives • of the project? 



l^at are the f irst^ targets for change? : School 

Juvejilie Court 
' • Other> ( specif y7^ 



What are the first strategies identified^ for iraplementlng change? : ^ 




^ . # 4/23/73 . ' 
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3Q0RCE OF DATA FOR #2 BELOW ; Interviews with principal Invefi- ^ ^ 

tlgatoi? or planner, project director, 
« and two staff memters, two board 
^ . * members and chairman of the board « 

2. Project's current experience characterized by. . Y 

the existence of ntamerou? or extensive Intra- ^ KH' 

organizational conflicts whliCh significantly ^ NA 
affect the work of^the project. — 



VALIDATING DATA 

•If response Is yes to above questl^bn, specify the basis for 
this conclusion: 

— - — — / — ^ — ^ 



SOURCE OF DATA FOR #'s 3^4^ and 5l Interviews with project 

^ director and staff. 



3* Inappropriate selection of targets. Check '*y" if Y 
either a or b applies: . \ U 

a. Target defined as city -wide or larger 
service system. 

b. Project providing class advocacy Identifies 
three or more targets (e.g. school. Juvenile 
Justice system, health services, public welfare 
system). ^ 

4. Strategies selected that are inappropriate to target. Y 

' . . NA~ 

(see next page for VALIDATING DATA) 
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f VALIDATING DATA 



m\a\ are the targets the project is trying to change? 

\ . . 

1) Individual case 

2) Individual school < 



IndlvlduaJL agency f specify) - ^ 

(specify) / ■ I 



Indlv±iaual policy . _ ^ 
5 J Individual procedure (specify) 
6) Budget 



l\ 



School system - 
Legislation (specify). 



^9) Justice system 

10) Heal-Mi services (specify) 
IX] Other\ (specify) 
12) None 




What strategies is the project using to implement change in 
these targets?: 

Pact finding and documentation 

Negotiation 

Persuasion 
Mass Publicit y ^ 
Court Action 



I! 



5, 
6.1 

I 



Organijzation of Coalitions^ 
Lobbyfrjg 



Public Dentonstration 
9} Other (specify) I 



(Targets #*s 7,8^9,10 and any other major target require the use of, 
at least five of the above strategies. Case advocacy may be achieved 
through the use of strategies 1-5; 6-8 are inappropriate. Class ad- 
vocacy may be achieved through the use of any 5 or more of these 
strategies) 

5.. staff without skills to achieve goals or Implement Y* 
strategies and no adequate provision of training - K f 
program to, ^mpensate for this, NA 



^ VALIDATING DATA 

SOURCE OF DATA : Interview with project director and staff. 

if there was a special training program for the advocate staff,, when 
did first training begin? (da^r, month^ year ) : 

When did training end? (day, month, year): ^ 

What was included in training? . (specify) : ; 
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SOURCE OP DATA FOR #6 BELOW : Interview i*bh project director. 

- ♦ 

6. Use of cjcash programming approach. • Y 



NA 



VALIDATINC^ DATA 



\ 



How long did it take for^the program to develop its regular 
program, activities or provide services reg\ilarly?: . ^ 

\\ Less than six months" • 
2) More than six months' 



More than eight but less than twelve months 
Other (specify) " 



SOURCE OF DATA FOR #7 BELOW ; Interviews with project director, 

staff aiid direct obsejrvation. 



7. Absence of case or class advocacy. Check ^'Y" if neither Y 
a nor b apply: N 

NA 

a. Project provides case advocacy (more than three 
Instances) • 



VALIDATING DATA 
Give four examples: 



b. Project provides class advocacy (at least one instance) 

VALIDATING DATA 



Give three examples : 




o 

FRIC 
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( C. For projects at the Implementation phase; Use the ^ 
foUovring tentati ve criteria ; 

— ■ ■ ■ " ■ ■ ■ I mm « 

SOURCE OF DATA FOR #'s 1,2^ and 3 : Interviews with project 

director, several staff 
members and some observation. 

1. Cas'e advocacy is provided regularly, meaning -Y 
a minimxm average of one case advocacy situa- 
tion per relevant staff member per week. NA 

(Part-time staf* or volxint^er workers' time 
shoiild be ^Jonverted into f\ill-time equivalents. 
e*g. Thirty-five hours of work«one wcrk week= 
one case^ advocacy ^tuation.) 



VALIDATING DftTA^ 

Quantity: Number of advocacy eases handled last month^ 
Niamber of advocacy cases handled last yearj^ 



Illustrate: Provide four exajnples and specify 
when they occurred. 



2. Class advocacy is ]?rovided regularly meaning a 

minimivn of six class advocacy situations dxxring , N_ 
the past six months. Thone nay be eithor class action na" 
suits, policy changes affecting a whole school or 
institution 

/ 

VALIDATING DATA 

Illxxetrate (provide f oiir examples and specify when they occurred) : 
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3. More than' 50^ of the staff time goes to the Y 
provision of advocacy activities. ' 



VALIDATING DATA 
Staff divide their tline each day as follows-: 

^ Providing Information, referral and brokerage services, 

Counseling or other direct services,' 
y> Report Writing, 

y survey or collecting Information, 

Administrative duties (speclfy)__ 

Attending Intra-agency meetings. 



llttcjndlng meetings outside of agency. 
Case advocacy. 
Glass advocacy. 



NA 



4, Has the project formed formal coalitions with. Y 
other groups or organizations? N 



VALIDATING DATA 

If yes, give names, addresses, types of orgeuilzatlons as well 
as names of coalition groups aund dates formed. 



5, Has the project been replicated elsewhere? - Y 

d 
. NA 



VALIDATING DATA 
If yes,^ where?: 



(I 



\ when ( date ) ? : 

CCC06 
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6. Does the project have a formal nclf -evaluation 
process? 



299 



Y 
N" 
NA" 



VALIDATING DATA 



If yes, obtain written report. 



7, Is staff training a regular, ongoing" part of the 
program? 



Y 

m 



VALIDATING DATA 
How frequently Is training program providedTj^ 
What, is date of most recent program? : 



ERIC 
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IV. 



RATING SUMMARY 



Plajming Phase 



Y 



ChecK as Scored 
ff—- 



NA 



:;tem #1 



Score Total 



3_ 
5 



Check as Soared 

Initiation Ph^se Y N NA 

Item #1^ ' • 



2_ K. 

3 



4_ 
r 

5_ 
6_ 

7 



7 



Score Total 



ERIC 
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Implementation Phase 



Check as Scored 



N 



NA 



Item # 1_ 

2_ 

3_ 
4_ 

5_ 



6_ 
7 



i: 



T 



Score Total: 



Score Summation - Indicia of Dlfflciilty 

Planning _(Y} 

Initiation (Y) 



Implementation (N) 
Final Score 



00309 
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V. Rating Stimmary 



Planning Phase 

.4 or more Indicia of difficulty have been checked Y 
fewer than 4 chfecked Y 



Initiation Phase 

5 or more Indicia of^ difficulty have been checked Y 
f^wer than 5 indicia have been checked Y ^ 



Both Phases Together; (In^lementation Prediction Capacity) 

9 or more indicia of difficxilty have been checked Y 

fewer than 5 indicia have beien checked Y * 



Predictive Probability for Implementation 



Prediction Accurate 



^ Prediction Inaccurate 

ERJC ^ C C i. 



E. vTO!0RANljin4 TO FIELD REPRESENTATIVES 
, \ , * April 25, 1973. 

TO:. Field Representatives 

FROM: -S. B. Kamerman ^ ^ " 

RE": Instructions for Field Visits 



I. To Classify Projects at Current Stage of Development ; 

A. ^ Interview (separately) Principatr Investigators, 

-Project Director and 2 staff i^Abers, regarding 
current project activities, r 

Major Focus -of Interview to be: 

1. , What is ,g6ing on now in the program? 

2. What is staff doing r>ow and what have they 
been doing for the p^st 6 months (for each 
category of staff: gtdministrative, supervisory, 
line)? - 

3. What are project* 9 ^rrent goals, objectives, 
purposes? Aqhl?Jl^ed how? (.Direct services, access, 
planning, res^arf^h, case and/or class advocacy) 

4. For all the above, obt?iin detailed illustrations 
and examples; frequency of activities. r 

B. Obtain appropriate written- material as indicated in 
the instrament. ' i 

• 

C. Dictate or write, a full narrative summary* as well as 
filling in the/ instrument. Where different responses < 
are^ given to the questions (e.g., director and staff 
view project goals Or staff roles differently) indicate 
this. When fillfhg in an instrument be sure to com- 
plete all items referrir^ to validating data and note 
fully on form or elsewhere, your reasons for response 
or^ conclusions, and any related comments. 
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II. Classification of Advocacy -anH Non -Advocacy Project^ 
„ • z 

Although by official definition all Jbhe projects you 
visit are child advocacy programs and met our clriteria 
when originally classified, there may have been changes. 
Therefore, please comment on how you perceive their * 
concept of child adirocacy and any difference you note 
between the projects ypu visit as to concept and practice 
• of advocacy, if they are now mis-classified, please 
indicate. 



III. Rate projects for current developments stage ONLY 

A. Since by definition no project you visit is in the 
planning stage, the critical issue here is to bjp 
clear whether a project is in the initiation or the 
implementation phase (or is fully implemented). 

Thus, for Part III, only B or C will be filled out. 

B. This instrument requires interviews with staff, 
Bo^rd members an^ clients as well as Project Direc- 
tors , and Principle Investigator. 



IV. A. In general, at the beginning of each interview be 
certainr that you explain the purpose of the study 
and assure complete confidentiality to each inter- 
viewee and to the project generally. 

B. Indicate independence of this project from federal 
funding agencies. We are not part of the federal 
evaluation or funding machinery. 

C. Do not use terms such as "case," "class" or "advocacy 
until the terms have been used by interviewees - or 
until activities which meet our definition of case 

y and/or class advocacy hafre been described/ 

D. Feel free to telephone me at the end of the first 
day (or at any other point during your vislTt^if 
there are things you want to discuss). , 

Office Telephone Number 280-4273 

348-2505 or 
348-3476 



SBKrwht 
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F. INTERVIEW SCHEDULE FOR PROJECT DIRECTOR 
~ AND FOR P^tTf(^^Kl"L CTV^tjTjlGATOR ~ 



INTRODUCTORY STATEMENT 

t 

(statement to be developed covering explanations to inter- 
^viewees re purposes and auspices of study, appropriate con- 
fidentiality, etc.) " - 

/ . . \ ' 



IDENTIFYING INFORMATION^ 



PROJECT NAIffi 



PROJECT ADDRESS 



INTERVIK'/EE mME 



INTERVIEWEE TITLE 



INTERVIEWEE TELEPHONE_ 
DATE OF INTERVIEW 



TIME OF INTERVIEW: BEGAN ENDED_ 

INTERVIEliTER NAME 
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F. EXCH^PTS FROM INTERVIEW SCHEDULE FOR PROJECT DIRECTOR 
I) (supplementary project) 



Now I'd like to get an idea of what the goals or purposes or 
objectives of your project «ire. 



5. Whaji are the real. things you are trying to accomplish? 

(Interviewer: Probe for definition of any ^erms...what 
do you raean^by..? Do not introduce any terms or defini- 
tions no^^supplied By respondent. Probe until goal 
statements are identified. ) 



GOAL STATBIENTS 
^ 



\ 



C 0 o 1 4 
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5.-.. Let !tie read back the e;ools you hiivo identified. Arc 
these, what you had in mind? (Revise if indicated) 

53. Kov/^ vjolild you tell me which you record as of primary 
importance, next in impor|;ance. third in imporiance 
and so on? ( Interviev/er record as fbllov^s: 



Goal of. ^Fri.uar}f Imp or tance 



< 



Goal Next in Inroortance 



Goal Third in Importance 



QJthey Goal(s) 



(.If respondent considers some goals as equally Ii^ortant, 
note this.) ^ " . 



6. 



6 

ERIC 



May we rhove to some statistical information on the different 
'type^ of staff activity carried pn in the pact 3 xTionths ? You 
may ;vish tor refer to statistical reoorcs. 



(Interviewer: If there is no eccivity reported in an erea, 
vjrite none and go* on to the ne:ct) 

Al. Hovf raany different clients (individuals or fr^milies, as 
counted the agency) vrera/orovirled v/ith direct case ^ 
-service by your staff. (For ev3:::ple\, coun-r-elin^, GUGoria^ij 
Inf orraa tion^ escort services y rerrerrpl ser^iceo , etc • for 
clients) - 

A3. VHiat do you eotiruite the? percent;^^j;e, of tott^l staff 
1 1 rtiz: i ve n t o c 1 1 i d a c c i v 1 " ? ^ 



31"* HoS luany conduct:! v;3>3 vl'*h p^ir;;onut?l (ao'i{>y th;^*\ 

your own n^erricy. '> u')f ^*) --o or !)btt;ji" s:*?-v\c3 

or %p ch^^n;o ohc v^y indlvirr:^:: cliqj^*:3 :v::iro v/i^a 
or to asGur^ l::^plG:uont'i':^i')n of cv;-.i :?:ae:its for 'indivi- 
dual client; 



or ra.tii..LiO'; 
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(Interviewer: In B2 and C2, the purpose is to see v;hether the ■ 
respondent is answering the statistical questions with the same 
framevrork in mind as the interviev;er . Pick up examples v/hich 
do not fit the framework, and revise the responses, if necessarj-. 
For example, B2 question is aimed at case advocacy, if the exam- 
ples are class advocacy, the number of actions and percent of 
man hoi^rs allocated properly "belong in C2. The reverse is true 
for C2, v/here th^ exanples may really belong in B2.) 



B2. What kinds of agencies, organizations or officials or 
groups vrere contacted for what purposes? 

Agency^ organization, group Purposes* 

or offici,al(s)' (Type): 



Agency, organization, group Purposes: 
or.official(s) (Type): . ■ . 



i Agency, organization, group v Purposes 
or official(s) (Type): ' 



Agency, organization, group Purpose s : 
^ or official(s) (Type): * ' 



ncy, organization, group Purposes : / • - 
or official(s) (Tj'pe):- 



• V 
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B3. What do you estiraate is the percentage of #total staff 
' tine given, to this activity?* ^ ^ 

CI* How many contacts, vrere made ;*rith personnel (other than 
your o;m agency staff) to discuss changes on behalf of 
groups or classes of clients? (For example, changes in 
programs., policies, lav/s, budgets, intake or other poli- 
cies, quality or level of concrete or bounseling services, 
structural arrangements , etc ^ ) * 

C2. What kinds qf agencies, organizations, off icials, * groups 
vrere contacted for what kinds of qhanges on behalf of 
groups or classes of clients? 

Agency^ organization, group Purposes : 

or official(&) (Type): ' 



Age^y, organization, group Purposes ; 

or official(s) (Type): - 



Agency, organization, group Purposes : 
or official(G) (Type): 



JL 



Agency, organization, group 
or official(3) (Type): 

. 7^ ■■ 



Agency J or^p-niT-.c oiori, iycjx- 
or ory?iciol(r;) (OJype): 



ruroo^es 
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C3- 'faat do you Gstimate is cho percentage oV total Gtaff 
time given to this activicy? " 

Dl. Hovf many different le:^al actions developed on beh,o.lf 
or individual clients? 

D?. What vrere the ley;al issues Involved? 



D3. Vrhat do you estimate- is the percentage of total staff 
time devoted to this activity? ^ 

El. Hov/ m^ny different legal actions vrere developed on "behalf 
of groups or classes of clients? 

E2. VJhat v;e2;;e the legal issues involved? 

^ — ■ — 



E3. vmat do ypu estimate is the total percentage of staff 
, time devoted to this activity? ^ ^ . 

( ) ■ " * ■ 

Fl. Eovi many different kinds of comraunity v/ork (for exajnple, 

participation in conimunity planning or coordination of 

services, com.T,unity education^ self-help development, e tc. ) 

did your project: engage in? < < " 



CC318 
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F?. What are the kinds olT corpni;nj \;ot:< you h^tv:xll'j 
cnsaced in for v;ha t ■ouroo3Ci^>? 



Kind or Cor^.Timity v;ork: 



Kind ox Communicy vrork': 



rurooses : 



Kind of Community vroric: 



KincT of CTomnujQi ty work : 



r^ijirooses 



Kind of Community ,v/ork: 



P3. VJhat do you estimate is the perc^nta^ie of ^total staff 
time devoted to this activity? ^ 

Gl, Are there any other sisnif ican-:^ -j'pss of activlcies not 
covered above vrhtch should ie zioz^.V^ If so^ Xihat is It? 



G3. WhaL do you estimate is the per: 
time ce'.^obed to bhio Ooh::-* ac;;/ 



;o^,3 or Lotal 



ERIC 



00319 



312 



(Iittervlew^r: Add up all the percentages. If the total 
exceeds 100, go over these again with respondent. If the' 
total launder 100, do not review.) 

{Interviewer, please note: 

Project Director estlmatea figures from memory, 
Troject Director uses figures from statistical reports. 
Other.- Specify: j 
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